-- Logs begin at Tue 2022-05-31 17:32:59 UTC, end at Tue 2022-05-31 18:51:07 UTC. -- May 31 18:15:47.653650 dv-cinder-839793-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 18:15:47.662076 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 18:15:47.664133 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 18:15:47 2022] *** May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: nodename: dv-cinder-839793-15-iscsi May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: machine: x86_64 May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: clock source: unix May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: pcre jit disabled May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: detected number of CPU cores: 4 May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: current working directory: / May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: detected binary path: /usr/bin/uwsgi-core May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: your processes number limit is 47680 May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: your memory page size is 4096 bytes May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: detected max file descriptor number: 2048 May 31 18:15:47.664621 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: lock engine: pthread robust mutexes May 31 18:15:47.665922 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: thunder lock: enabled May 31 18:15:47.665922 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 18:15:47.665922 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 18:15:47.709771 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: Python main interpreter initialized at 0x55b01ccf89c0 May 31 18:15:47.709771 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: python threads support enabled May 31 18:15:47.709771 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: your server socket listen backlog is limited to 100 connections May 31 18:15:47.709771 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: your mercy for graceful operations on workers is 90 seconds May 31 18:15:47.710197 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: mapped 403077 bytes (393 KB) for 2 cores May 31 18:15:47.710197 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: *** Operational MODE: preforking *** May 31 18:15:47.710467 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: *** uWSGI is running in multiple interpreter mode *** May 31 18:15:47.710467 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: spawned uWSGI master process (pid: 103169) May 31 18:15:47.710682 dv-cinder-839793-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 18:15:47.711255 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: spawned uWSGI worker 1 (pid: 103170, cores: 1) May 31 18:15:47.711599 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: spawned uWSGI worker 2 (pid: 103171, cores: 1) May 31 18:15:47.713139 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 18:15:48.958086 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 18:15:48.958743 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 18:15:49.683082 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:15:49.683082 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes May 31 18:15:49.683354 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:15:49.683354 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: from cryptography.utils import int_from_bytes May 31 18:15:49.683708 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:15:49.683708 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes May 31 18:15:49.684048 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:15:49.684048 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: from cryptography.utils import int_from_bytes May 31 18:15:52.284814 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 18:15:52.285977 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 18:15:52.285977 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 18:15:52.286493 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 18:15:52.286576 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 18:15:52.286663 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 18:15:52.286748 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 18:15:52.286844 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 18:15:52.286924 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 18:15:52.287001 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 18:15:52.287415 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.287529 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.287624 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.287704 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.287925 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288014 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288267 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288368 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288596 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288684 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288908 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.288993 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.289228 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.289315 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.289546 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.289645 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.289889 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290035 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290128 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290215 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290432 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290529 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290752 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-15-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.290843 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-15-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.291073 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.291158 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.291375 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.291466 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.291684 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.291823 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292001 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292117 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292329 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292427 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292649 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292744 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.292953 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.293038 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.293448 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.293548 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.294602 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.294735 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.294851 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.294954 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295034 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295118 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295257 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295347 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295347 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295544 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295633 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295758 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295849 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.295934 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.296011 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.296156 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.296324 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.296456 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.296633 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.296772 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297027 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-15-iscsi {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297202 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-15-iscsi {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297343 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297653 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297783 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.297963 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.298098 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.298374 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.298516 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.298683 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.298832 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.298990 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.299142 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.299307 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.299464 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.299624 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.299790 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.299930 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.300121 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.300278 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.300450 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.300637 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.300921 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301018 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301245 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301346 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301568 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301655 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301873 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.301959 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.302184 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.302278 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.302495 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.302582 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.302816 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.302910 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303117 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303211 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303366 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303458 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303661 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303756 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.303971 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304142 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304315 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304410 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304635 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304723 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304885 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.304982 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.305118 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.305203 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.305436 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.305536 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.305754 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.305900 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306056 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306141 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306361 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306460 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306665 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306750 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.306969 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307055 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307275 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307369 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307580 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307666 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307885 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.307968 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.308210 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.308300 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.308518 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.308602 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.308829 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.308924 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.309143 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.309230 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.309446 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.309529 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.309762 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.309846 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.310085 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.310171 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.310392 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.310480 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.310697 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.310783 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311019 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311113 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311335 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311426 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311640 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311733 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.311956 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312042 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312300 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312386 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312604 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312701 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312908 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.312993 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.313211 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.313296 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.313518 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.313610 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.313838 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.313922 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314139 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314222 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314388 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314484 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314686 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314773 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.314985 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315069 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315292 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315378 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315593 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315679 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315897 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.315982 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.316311 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.316426 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.316532 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.316674 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.316900 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317026 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317275 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317394 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317580 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317668 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317883 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.317981 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.318187 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.318274 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.318489 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.318574 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.318792 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.318879 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.319094 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.319193 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.319396 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.319488 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.319702 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.319797 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320018 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320121 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320358 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320443 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320662 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320761 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.320965 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321059 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321266 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321362 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321570 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321667 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321871 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.321965 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.322172 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.322267 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.322481 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.322566 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.322784 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.322870 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323087 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323179 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323390 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323484 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323695 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323779 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.323998 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.324110 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.324329 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.324427 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.324627 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.324712 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.324929 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325025 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325235 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325333 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325534 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325626 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325835 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.325928 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.326136 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.326231 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.326438 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.326530 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.326736 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.326819 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.327093 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334180 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334332 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334466 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334581 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334698 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334817 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.334931 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335043 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335156 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335268 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335375 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335490 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335712 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335815 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.335926 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.336039 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.336182 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.336304 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.336418 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.336525 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:15:52.336636 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.336761 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.336875 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.336986 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337091 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337202 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337308 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337424 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337536 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337640 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337743 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337846 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337948 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.337948 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338260 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338474 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338589 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338695 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338798 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.338915 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339018 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339120 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339231 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339342 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339457 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339569 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339694 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339818 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.339928 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340052 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340211 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340328 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340439 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340544 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340657 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340762 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340865 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.340969 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341071 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341173 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341290 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341403 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341507 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341610 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341713 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341816 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.341932 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342037 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342141 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342267 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342397 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342545 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342710 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342836 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.342966 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343096 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343219 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343349 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343479 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343609 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343766 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.343898 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.344558 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.344660 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.344749 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.344836 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.344924 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345004 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345095 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345175 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345260 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345338 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345415 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345492 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345492 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345643 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345643 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345784 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345784 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.345947 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346027 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346111 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346190 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346268 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346352 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346515 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346598 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346675 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346760 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346838 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.346915 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347000 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347080 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347247 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347326 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347403 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.347526 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348192 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348275 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348405 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348502 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348583 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348722 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348722 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348917 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.348917 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349063 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349063 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349215 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349427 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349762 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349873 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.349969 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350065 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350154 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350241 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350320 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350404 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350717 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.350805 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351031 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351117 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351336 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351429 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351648 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351735 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.351959 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.352044 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.352291 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.352388 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.352616 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.352709 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.352924 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353012 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353231 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353326 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353548 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353658 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353852 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.353938 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.354161 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.354256 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.354474 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.354581 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.354786 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.354876 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.355094 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.355194 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.355408 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.355503 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.355719 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.355804 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.356044 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.356153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.356393 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.356481 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.356697 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.356783 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357022 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357109 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357345 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357431 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357653 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357737 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.357954 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358048 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358326 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358430 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358567 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358673 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358869 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.358957 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.359240 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.359349 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.359481 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.359577 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.359785 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.359870 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.360142 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.360232 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.360406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.360506 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.360708 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.360797 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361010 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361097 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361312 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361412 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361619 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361707 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.361917 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362002 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362217 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362313 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362519 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362829 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.362915 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.363687 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.363782 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.363996 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.364129 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.364367 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.364494 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.364676 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.364771 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365020 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365115 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365357 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365450 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365673 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365761 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.365984 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.366072 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.366295 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.366381 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.366605 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.366699 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.366914 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367002 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367231 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367326 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367537 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367631 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367848 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.367942 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.368179 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.368281 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.368494 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.368580 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.368800 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.368893 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.369115 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.369209 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.369416 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.369508 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.369729 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.369815 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370049 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370142 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370355 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370440 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370674 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370775 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.370993 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.371087 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.371637 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.371756 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.371838 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.371916 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372003 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372119 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372226 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372314 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372537 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372625 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372892 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.372995 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.373163 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.373252 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.373471 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.373558 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.373793 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.373997 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.374094 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.374189 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.374434 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.374602 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.374878 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.374972 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375040 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375103 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375315 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375416 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375626 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375713 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.375950 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.376037 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.376312 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.376433 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.376616 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.376703 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.376924 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.377011 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.377244 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.377345 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.377819 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.377912 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.378132 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.378229 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.378436 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.378538 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.379341 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.379468 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.379655 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.379762 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.379965 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.380081 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.380303 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.380422 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.380613 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.380730 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.380923 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381046 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381225 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381363 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381539 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381676 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381847 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.381989 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.382151 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.382296 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.382453 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.382614 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.382762 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.382927 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.383080 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.383236 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.383388 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.383542 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.383706 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.383854 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384025 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384200 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384360 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384563 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384663 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384836 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.384970 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.385160 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.385276 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.385467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.385563 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.385774 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.385860 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.386100 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.386184 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.386411 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.386497 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.386719 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.386819 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387030 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387156 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387344 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387453 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387669 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387763 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.387977 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.388077 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.388305 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.388392 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.388613 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.388698 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.388921 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389016 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389235 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389321 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389541 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389627 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389849 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.389958 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.390158 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.390252 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.390462 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.390554 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.390770 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.390865 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391076 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391162 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391386 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391470 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391690 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391784 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.391996 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.392082 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.392328 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.392413 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.392631 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.392717 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.392936 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.393023 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.393248 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.393333 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.393559 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.393823 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.393909 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.394153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.394258 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.394577 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.394687 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.394963 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.395166 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.395255 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.395503 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.395605 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.395823 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.395909 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.396167 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.396260 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.396494 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.396592 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.396820 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.396914 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.397102 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.397210 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.397408 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.397500 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.397713 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.397812 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398023 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398122 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398326 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398425 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398627 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398726 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.398931 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399028 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399241 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399335 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399545 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399718 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399849 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.399939 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.400175 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.400277 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.400482 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.400578 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.400794 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.400880 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.401097 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.401182 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.401405 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.401504 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.401708 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.401802 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402021 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402119 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402326 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402413 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402627 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402713 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.402926 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403021 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403226 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403313 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403546 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403640 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403854 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.403941 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.404183 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.404275 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.404491 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.404577 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.404835 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.404939 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.405183 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.405280 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.405554 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.405640 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.405884 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.405981 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.406215 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.406299 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.406523 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.406609 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.406828 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.406924 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.407138 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.407294 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.407445 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.407531 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.407749 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.407851 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.408054 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.408170 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.408442 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.408551 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.408697 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.408797 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.409004 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.409089 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.409306 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.409392 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.409613 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.409701 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.410448 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.410599 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.410755 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.410877 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411058 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411145 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411362 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411447 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411664 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411758 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.411971 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412059 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412304 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412411 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412605 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412700 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412906 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.412992 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.413204 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.413289 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.413515 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.413610 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.413814 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.413899 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.414119 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.414205 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.414420 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.414520 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.414726 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.414818 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415029 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415118 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415331 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415452 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415631 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415725 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.415941 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416035 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416274 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416362 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416670 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416882 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.416969 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.417183 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.417272 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.417484 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.417569 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.417787 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.417872 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.418098 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.418194 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.418402 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.418490 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.418699 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.418784 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419094 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419308 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419395 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419607 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419702 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419906 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.419993 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.420236 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.420431 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.420538 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.420635 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.420837 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.420987 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.421137 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.421299 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.421435 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.421612 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.421734 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.421918 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422052 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422223 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422359 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422527 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422659 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422832 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.422958 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.423137 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.423258 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.423460 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.423595 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.423770 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.423896 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.424075 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.424280 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.424400 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.424584 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.424705 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.424895 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.425049 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.425210 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.425403 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.425566 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.425763 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.425908 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.426068 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.426214 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.426442 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.426591 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.426769 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.426935 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.427095 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.427260 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.427419 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.427633 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.427795 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.427945 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428152 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428322 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428471 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428618 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428618 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428794 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.428955 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429043 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429205 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429293 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429509 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429596 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429827 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.429922 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.430131 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.430217 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.430438 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.430523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.430746 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.430835 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431052 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431138 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431358 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431457 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431664 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431749 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.431969 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.432056 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.432304 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.432409 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.432612 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.432697 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.432922 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433015 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433225 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433319 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433529 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433623 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433835 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.433922 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.434146 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.434243 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.434446 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.434537 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.434756 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.434842 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435062 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435199 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435363 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435501 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435673 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435786 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.435975 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.436073 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.436307 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.436394 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.436609 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.436708 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.436913 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437042 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437232 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437351 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437541 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437674 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437854 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.437943 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.438161 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.438247 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.438531 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.438624 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.438842 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.438928 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.439151 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.439236 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.439453 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.439553 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.439780 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.439866 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.440109 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.440200 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.440433 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.440533 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.440747 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.440844 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.441053 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.441678 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.441901 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.442035 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.442277 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.442418 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.442601 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.442740 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.442905 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443056 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443208 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443366 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443510 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443674 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443829 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.443988 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.444157 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.444421 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.444511 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.444764 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.444882 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445039 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445170 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445347 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445473 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445671 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445882 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.445973 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.446190 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.446275 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.446497 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.446687 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.446814 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.447008 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.447131 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.447315 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.447450 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.447733 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.447821 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.448046 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.448185 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.448376 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.448462 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.448696 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.448809 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449182 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449316 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449424 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449528 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449624 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449711 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449911 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.449999 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.450224 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.450309 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.450539 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.450623 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.450850 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.450937 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.451159 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.451245 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.451475 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.451781 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.451875 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.452114 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.452228 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.452480 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.452570 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.452794 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.452882 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.453118 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.453204 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.453421 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.453535 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.453726 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.453859 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454044 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454171 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454349 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454494 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454654 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454819 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.454974 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.455126 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.455279 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.455425 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.455589 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.455721 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.455897 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.456023 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.456239 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.456341 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.456546 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.456662 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.457495 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.457726 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.457860 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.458101 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.458284 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.458423 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.458614 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.458740 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.458931 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.459056 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.459253 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.459368 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.459580 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.459695 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.459883 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460005 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460234 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460359 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460578 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460680 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460851 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.460992 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.461154 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.461321 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.461459 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.461633 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.461800 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462030 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462132 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462273 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462580 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462733 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.462887 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.463056 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.463195 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.463367 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.463539 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.463698 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.463845 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.464023 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.464189 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.464369 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.464525 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.464686 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.464856 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465007 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465171 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465311 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465507 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465596 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465839 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.465934 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.466158 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.466253 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.466482 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.466577 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.466783 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.466868 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.467090 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.467190 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.467392 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.467533 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.469692 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.469806 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.469878 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.469962 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.469962 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470097 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470163 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470235 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470308 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470386 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470461 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470534 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470599 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470662 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470726 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470841 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470841 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470977 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.470977 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471094 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471094 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471227 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471227 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471352 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471418 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471482 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471582 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.471660 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472027 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472149 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472233 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472312 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472602 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472822 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.472943 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473032 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473263 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473351 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473578 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473666 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473888 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.473976 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.474207 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.474304 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.474520 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.474608 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.474833 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.474920 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.475140 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.475240 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.475452 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.475582 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.475763 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.475888 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.476082 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.476276 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.476420 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.476667 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.476782 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.476995 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.477093 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.477311 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.477403 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.477625 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.477712 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.477938 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.478036 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.478250 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.478492 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.478587 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.478824 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.478911 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.479140 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.479229 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.479453 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.479538 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.479763 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.479850 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.480079 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.480189 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.480415 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.480504 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.480732 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.480829 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481048 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481147 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481361 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481448 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481673 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481767 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.481985 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.482072 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.482297 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.482411 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.482631 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.482727 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.482952 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483038 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483258 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483346 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483572 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483659 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483884 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.483969 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.485597 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.485762 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.485941 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486030 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486122 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486122 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486268 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486363 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486363 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486561 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486561 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486713 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.486801 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.487079 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.487175 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.487401 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.487681 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.487770 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.488041 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.488347 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.488433 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.488684 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.488944 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.489041 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.489332 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.489530 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.489655 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.489972 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.490096 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.490286 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.490604 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.490691 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.491031 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.491138 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.491411 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.491506 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.491746 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.491833 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.492144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.492377 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.492487 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.492750 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.492836 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.493072 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.493158 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.493400 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.493495 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.493711 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.493803 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494021 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494108 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494337 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494508 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494652 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494868 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.494955 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.495202 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.495296 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.495516 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.495605 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.495837 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.495925 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.496181 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.496286 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.496496 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.496585 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.496824 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.497029 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.497125 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.497391 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.497480 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.497712 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.497799 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.498043 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.498130 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.498374 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.498574 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.498696 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.498926 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499013 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499245 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499341 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499572 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499661 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499897 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.499991 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.500241 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.500333 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.500552 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.500638 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.500859 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.500945 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.501166 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.501255 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.501469 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.501562 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.501782 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.501868 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.502091 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.502236 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.502398 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.502486 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.502969 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.503061 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.503280 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.503377 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.503592 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.504201 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.504429 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.504529 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.504735 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.504822 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505042 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505128 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505348 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505442 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505656 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505744 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.505960 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506054 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506266 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506364 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506668 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506880 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.506966 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.507181 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.507279 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.507487 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.507582 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.507792 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.507879 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.508126 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.508217 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.508418 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.508506 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.508729 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.508815 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509033 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509121 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509344 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509440 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509646 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509742 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.509954 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510042 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510268 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510355 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510592 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510678 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510904 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.510990 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.511206 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.511293 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.511521 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.511617 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.511830 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.511966 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.512173 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.512414 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.512514 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.512747 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.512836 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.513069 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.513156 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.513403 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.513492 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.513735 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.513936 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.514047 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.514269 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.514402 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.514594 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.514788 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.514925 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.515119 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.515253 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.515473 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.515561 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.515794 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.515871 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.516134 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.516215 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.516446 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.516602 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.516762 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.516841 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517069 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517145 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517377 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517466 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517685 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517762 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.517994 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518069 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518299 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518384 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518606 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518683 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518915 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.518989 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.519236 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.519351 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.520168 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.520266 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.520482 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.520602 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.520791 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.520929 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.521099 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.521255 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.521442 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.521577 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.521737 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.521896 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.522054 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.522211 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.522371 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.522525 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.522686 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.522837 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523002 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523149 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523312 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523468 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523621 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523798 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.523927 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.524136 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.524261 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.524530 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.524634 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.524886 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525110 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525194 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525428 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525514 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525594 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525815 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.525911 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.526128 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.526227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.526449 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.526537 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.526774 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.526862 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.527088 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.527186 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.527407 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.527505 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.527724 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.527811 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.528029 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.528138 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.528906 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529089 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529189 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529273 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529362 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529444 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529522 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529600 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529678 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.529839 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530014 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530100 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530227 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530316 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530527 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530628 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530868 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.530969 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.531134 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.531216 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.531437 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.531534 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.531745 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532430 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532574 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532659 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532738 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532833 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532914 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.532992 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533240 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533333 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533424 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533512 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533599 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533679 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533812 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.533900 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.534119 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.534204 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.534427 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.534595 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.534725 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.534886 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535055 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535166 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535340 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535426 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535643 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535823 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.535943 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536034 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536270 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536358 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536569 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536670 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536870 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.536957 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.537169 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.537255 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.537468 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.537564 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.537769 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.537857 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.538098 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.538185 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.538428 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.538525 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.538742 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.538838 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539051 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539137 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539357 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539456 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539779 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.539981 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.540069 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.540316 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.540405 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.540631 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.540717 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.540945 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541083 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541251 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541344 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541560 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541654 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541875 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.541963 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.542180 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.542315 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.542486 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.542610 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.542794 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.542882 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.543101 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.543189 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.543407 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.543493 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.543728 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.543823 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.544048 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.544155 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.544384 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.544471 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.544701 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.544800 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545015 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545109 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545332 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545419 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545652 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545881 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.545972 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546052 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546258 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546355 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546570 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546659 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546881 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.546970 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.547199 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.547287 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.547504 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.547592 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.547813 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.547901 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.548146 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.548239 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.548464 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.548554 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.548791 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.548877 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.549115 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.549211 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.549421 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.549510 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.549743 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.549838 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.550067 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.550163 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.550403 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.550516 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.550742 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.550971 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.551082 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.551170 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.551452 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.551546 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.551699 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103171) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 18:15:52.551820 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.552154 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.552462 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:15:52.552704 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103170) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 18:15:52.610920 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Registered counter for database nova_api May 31 18:15:52.611261 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Registered counter for database nova_api May 31 18:15:52.633595 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.635292 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.641129 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.642788 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.698349 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.context [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e77dd333-c7fe-440b-84b1-5d076cdc10bf(cell1) {{(pid=103170) load_cells /opt/stack/nova/nova/context.py:464}} May 31 18:15:52.700128 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.context [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e77dd333-c7fe-440b-84b1-5d076cdc10bf(cell1) {{(pid=103171) load_cells /opt/stack/nova/nova/context.py:464}} May 31 18:15:52.702516 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:15:52.704114 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:15:52.704282 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:15:52.704909 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:15:52.705857 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:15:52.706666 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:15:52.707482 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:15:52.709305 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_concurrency.lockutils [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103171) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:15:52.709471 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Registered counter for database nova_cell0 May 31 18:15:52.711317 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Registered counter for database nova_cell0 May 31 18:15:52.713494 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Registered counter for database nova_cell1 May 31 18:15:52.715372 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Registered counter for database nova_cell1 May 31 18:15:52.721315 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.722548 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.728468 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.729252 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.730017 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.730537 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.743158 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.744778 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.878741 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO dbcounter [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Registered counter for database nova_cell0 May 31 18:15:52.887501 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_db.sqlalchemy.engines [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103170) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.891984 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writer thread running {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:52.893512 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO dbcounter [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Registered counter for database nova_cell0 May 31 18:15:52.901467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG oslo_db.sqlalchemy.engines [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103171) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:15:52.905864 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writer thread running {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:15:53.356140 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:15:53.360008 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:15:53.364440 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:15:53.368683 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:15:53.588067 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:15:53.593969 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: WARNING keystonemiddleware.auth_token [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:15:53.594630 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:15:53.599736 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b01ccf89c0 pid: 103170 (default app) May 31 18:15:53.601367 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: WARNING keystonemiddleware.auth_token [None req-7060f009-2279-4b61-9495-cd08edcdd970 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:15:53.602106 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:15:53.603283 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] 10.222.0.17 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001995 May 31 18:15:53.603697 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 1/1] 10.222.0.17 () {50 vars in 788 bytes} [Tue May 31 18:15:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:15:53.606495 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b01ccf89c0 pid: 103171 (default app) May 31 18:17:16.422771 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:16.424790 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002626 May 31 18:17:16.433326 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 2/2] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:16 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:16.447961 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:16.450024 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:16.451173 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell1:SELECT=3 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:16.452124 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:16.913503 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-e1dc4cb4-540a-4a14-9679-d96e8e7ca653 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:16.944481 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-e1dc4cb4-540a-4a14-9679-d96e8e7ca653 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.508067 May 31 18:17:16.945239 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 1/3] 10.222.0.17 () {60 vars in 1291 bytes} [Tue May 31 18:17:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:19.402168 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:19.403169 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-ea43c56c-700c-4abc-93f1-7f451b82096d None None] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 May 31 18:17:19.403577 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 3/4] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:19.478709 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-97ed2fe1-c721-4c38-817e-dc506f7118f7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 256}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:19.497041 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:17:19.497041 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) May 31 18:17:19.527422 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-97ed2fe1-c721-4c38-817e-dc506f7118f7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116662 May 31 18:17:19.528371 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 2/5] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 18:17:19.543200 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:19.544235 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:19.545317 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=3 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:19.546096 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:17:19.768865 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-7ee51f7f-0fec-44c1-9f22-4a0665c792c3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:19.772411 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:17:19.772411 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: warnings.warn(msg) May 31 18:17:19.840104 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-7ee51f7f-0fec-44c1-9f22-4a0665c792c3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303374 May 31 18:17:19.846256 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 4/6] 10.222.0.17 () {64 vars in 1335 bytes} [Tue May 31 18:17:19 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:22.201298 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-97ed2fe1-c721-4c38-817e-dc506f7118f7 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:22.202329 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-97ed2fe1-c721-4c38-817e-dc506f7118f7 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 31 18:17:22.202761 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 3/7] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:22.322517 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bb04fc53-526b-44fe-86e9-12e520318e14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "name": "ds512M", "id": "d1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:22.351772 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:17:22.351772 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: warnings.warn(msg) May 31 18:17:22.379896 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bb04fc53-526b-44fe-86e9-12e520318e14 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.170090 May 31 18:17:22.381141 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 5/8] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:22.392840 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-c8a743e9-6baa-4e20-a553-173cdd08b20f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:22.395163 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:17:22.395163 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: warnings.warn(msg) May 31 18:17:22.427820 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-c8a743e9-6baa-4e20-a553-173cdd08b20f admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038673 May 31 18:17:22.428458 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 4/9] 10.222.0.17 () {64 vars in 1335 bytes} [Tue May 31 18:17:22 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:24.801688 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-bb04fc53-526b-44fe-86e9-12e520318e14 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:24.802744 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-bb04fc53-526b-44fe-86e9-12e520318e14 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 May 31 18:17:24.803240 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 6/10] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:24.871293 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-bea362e6-7a57-45ba-ac63-6604b4d7703a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "vcpus": 1, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:24.896329 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-bea362e6-7a57-45ba-ac63-6604b4d7703a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.086224 May 31 18:17:24.897163 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 5/11] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:24.909244 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-f6b11702-82ed-4f4a-bd50-cf2271e61ff7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:24.933811 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-f6b11702-82ed-4f4a-bd50-cf2271e61ff7 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028255 May 31 18:17:24.934612 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 7/12] 10.222.0.17 () {64 vars in 1335 bytes} [Tue May 31 18:17:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:27.314208 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-bea362e6-7a57-45ba-ac63-6604b4d7703a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:27.315218 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-bea362e6-7a57-45ba-ac63-6604b4d7703a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001854 May 31 18:17:27.315621 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 6/13] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:27.389919 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-86ede976-94c6-48df-a128-38e730d6ca18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "ram": 2048, "name": "ds2G", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:27.413239 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-86ede976-94c6-48df-a128-38e730d6ca18 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.090788 May 31 18:17:27.413796 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 8/14] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:27.426051 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-5f1aede2-9163-4730-9f30-64cdbde20443 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:27.450346 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-5f1aede2-9163-4730-9f30-64cdbde20443 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028078 May 31 18:17:27.451133 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 7/15] 10.222.0.17 () {64 vars in 1335 bytes} [Tue May 31 18:17:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:17:29.887752 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-86ede976-94c6-48df-a128-38e730d6ca18 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:29.888908 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-86ede976-94c6-48df-a128-38e730d6ca18 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 May 31 18:17:29.889371 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 9/16] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:17:29.951476 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-672ddefd-4357-457e-8ba5-cbaa3ed265d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "ram": 4096, "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:29.973927 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-672ddefd-4357-457e-8ba5-cbaa3ed265d2 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.078142 May 31 18:17:29.974723 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 8/17] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:29.986246 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-06a9dd5c-0ccf-4127-8433-3404191b3e4b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:30.012871 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-06a9dd5c-0ccf-4127-8433-3404191b3e4b admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030204 May 31 18:17:30.013455 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 10/18] 10.222.0.17 () {64 vars in 1335 bytes} [Tue May 31 18:17:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:17:32.413681 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-672ddefd-4357-457e-8ba5-cbaa3ed265d2 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:32.414853 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-672ddefd-4357-457e-8ba5-cbaa3ed265d2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001559 May 31 18:17:32.421709 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 9/19] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:32 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:32.482964 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e2dafc25-eb4e-4b16-b52c-9f8a502a48b3 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:32.510925 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-e2dafc25-eb4e-4b16-b52c-9f8a502a48b3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088920 May 31 18:17:32.511488 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 11/20] 10.222.0.17 () {60 vars in 1291 bytes} [Tue May 31 18:17:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:17:35.096778 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-672ddefd-4357-457e-8ba5-cbaa3ed265d2 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:35.099084 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-672ddefd-4357-457e-8ba5-cbaa3ed265d2 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002681 May 31 18:17:35.099710 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 10/21] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:35.194317 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6b4c6582-9fbe-409c-9dfb-1019aa2c8ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "m1.tiny", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "id": "1", "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:35.216996 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6b4c6582-9fbe-409c-9dfb-1019aa2c8ba3 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.110565 May 31 18:17:35.217894 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 12/22] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:35.230981 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-dcf81d82-6fc4-45c6-849a-17a14fe68710 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:35.257206 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-dcf81d82-6fc4-45c6-849a-17a14fe68710 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029973 May 31 18:17:35.257806 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 11/23] 10.222.0.17 () {64 vars in 1332 bytes} [Tue May 31 18:17:35 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:38.028254 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-6b4c6582-9fbe-409c-9dfb-1019aa2c8ba3 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:38.029593 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-6b4c6582-9fbe-409c-9dfb-1019aa2c8ba3 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 May 31 18:17:38.030146 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 13/24] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:38.097811 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-2c66fe7f-0a0b-43de-b2e1-cb795ea3303a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "vcpus": 1, "disk": 20, "name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:38.117879 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-2c66fe7f-0a0b-43de-b2e1-cb795ea3303a admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079745 May 31 18:17:38.120132 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 12/25] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 18:17:38.132689 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-d5dde1b1-a026-4d7c-b1b0-7f77c551cb4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:38.157005 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-d5dde1b1-a026-4d7c-b1b0-7f77c551cb4c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029526 May 31 18:17:38.157606 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 14/26] 10.222.0.17 () {64 vars in 1332 bytes} [Tue May 31 18:17:38 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:40.919103 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-2c66fe7f-0a0b-43de-b2e1-cb795ea3303a admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:40.920145 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-2c66fe7f-0a0b-43de-b2e1-cb795ea3303a admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 May 31 18:17:40.920554 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 13/27] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:40.986549 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-2cae09e8-b369-4780-9d54-adc6c5e1718d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:41.006333 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-2cae09e8-b369-4780-9d54-adc6c5e1718d admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.079075 May 31 18:17:41.006905 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 15/28] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:40 2022] POST /compute/v2.1/flavors => generated 406 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:41.019327 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-9c45ddc6-25ec-4014-aa8d-d78fdf479365 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:41.045034 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-9c45ddc6-25ec-4014-aa8d-d78fdf479365 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029978 May 31 18:17:41.045598 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 14/29] 10.222.0.17 () {64 vars in 1332 bytes} [Tue May 31 18:17:41 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:43.573048 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-2cae09e8-b369-4780-9d54-adc6c5e1718d admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:43.574082 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-2cae09e8-b369-4780-9d54-adc6c5e1718d admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 May 31 18:17:43.574487 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 16/30] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:43.634576 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-7c0d1865-f585-4409-8d18-3a845f91cf0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:43.657831 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-7c0d1865-f585-4409-8d18-3a845f91cf0c admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076936 May 31 18:17:43.660150 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 15/31] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:43.670349 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-a4ec5003-f454-48e6-80dd-cd8985c3d0b0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:43.694917 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-a4ec5003-f454-48e6-80dd-cd8985c3d0b0 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028226 May 31 18:17:43.695907 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 17/32] 10.222.0.17 () {64 vars in 1332 bytes} [Tue May 31 18:17:43 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:17:46.085082 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-7c0d1865-f585-4409-8d18-3a845f91cf0c admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:17:46.086107 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-7c0d1865-f585-4409-8d18-3a845f91cf0c admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 31 18:17:46.086508 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 16/33] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:17:46.163986 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3a9626d3-42d5-40e9-874a-f05e96b63fa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.xlarge", "id": "5", "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "swap": 0}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:46.185553 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3a9626d3-42d5-40e9-874a-f05e96b63fa1 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.092630 May 31 18:17:46.186158 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 18/34] 10.222.0.17 () {64 vars in 1282 bytes} [Tue May 31 18:17:46 2022] POST /compute/v2.1/flavors => generated 408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:17:46.198716 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-5721c28b-1b95-4dfb-9256-d5ce2bb59f95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:17:46.226801 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-5721c28b-1b95-4dfb-9256-d5ce2bb59f95 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031900 May 31 18:17:46.227471 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 17/35] 10.222.0.17 () {64 vars in 1332 bytes} [Tue May 31 18:17:46 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:18:10.833466 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3a9626d3-42d5-40e9-874a-f05e96b63fa1 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:10.834508 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3a9626d3-42d5-40e9-874a-f05e96b63fa1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 May 31 18:18:10.834966 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 19/36] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:10.847070 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:18:10.898884 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-2d82799d-bee4-46c0-b811-530fbb805898 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:10.916152 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-2d82799d-bee4-46c0-b811-530fbb805898 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073819 May 31 18:18:10.916709 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 18/37] 10.222.0.17 () {60 vars in 1291 bytes} [Tue May 31 18:18:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:18:11.942615 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3a9626d3-42d5-40e9-874a-f05e96b63fa1 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:11.943639 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3a9626d3-42d5-40e9-874a-f05e96b63fa1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 31 18:18:11.944046 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 20/38] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:12.144970 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a0e0ce0c-e66e-49a2-89ed-ef76501a427d admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:12.150812 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-a0e0ce0c-e66e-49a2-89ed-ef76501a427d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a0e0ce0c-e66e-49a2-89ed-ef76501a427d admin admin] Request method failure captured: May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Accept: application/json May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Connection: keep-alive May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Content-Length: 0 May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Host: 10.222.0.17 May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABillvjdZWT-xKSfAXxvj0GTGGX8J75afctkcNHFeekDOfVRwy8xEHHoBTn0IbjNfxexcBxW5LU60bicSxCb9JFVTTlGccIadQ8bKhr5zY2jNgdLlqV2pLczpO0t1d1JgYvlGP-g9Bn1PlTKcEtBjl-Zl3Je3rmxwvHeHs2ylv6sIFa8DA May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Domain-Id: None May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Domain-Name: None May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Name: admin May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member May 31 18:18:12.154246 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d50faa712b7648baa5d54974b81b7361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant: admin May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User: admin May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Id: de26ccbcde994176a74c04b6bbaf777d May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Name: admin May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: method: > May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: exception: Flavor 42 could not be found. May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: action_args: {'id': '42'} May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:18:12.158523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:12.159729 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:12.161467 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-a0e0ce0c-e66e-49a2-89ed-ef76501a427d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:18:12.163024 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-a0e0ce0c-e66e-49a2-89ed-ef76501a427d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.070142 May 31 18:18:12.163024 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 19/39] 10.222.0.17 () {60 vars in 1190 bytes} [Tue May 31 18:18:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 18:18:12.172735 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-58a0edae-ed3e-4339-be4e-dbf968442fed admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:12.176611 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:18:12.199152 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-58a0edae-ed3e-4339-be4e-dbf968442fed admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030278 May 31 18:18:12.200020 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 21/40] 10.222.0.17 () {60 vars in 1210 bytes} [Tue May 31 18:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:18:12.213615 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-8a160d62-6c34-498b-b1f0-b0d83babeb69 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:12.235843 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-8a160d62-6c34-498b-b1f0-b0d83babeb69 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025773 May 31 18:18:12.236451 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 20/41] 10.222.0.17 () {60 vars in 1210 bytes} [Tue May 31 18:18:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:18:12.247033 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9e47f55e-0758-448e-805b-189d37bdbeca admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:12.253797 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-9e47f55e-0758-448e-805b-189d37bdbeca admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9e47f55e-0758-448e-805b-189d37bdbeca admin admin] Request method failure captured: May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Accept: application/json May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Connection: keep-alive May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Content-Length: 0 May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Host: 10.222.0.17 May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABillvjdZWT-xKSfAXxvj0GTGGX8J75afctkcNHFeekDOfVRwy8xEHHoBTn0IbjNfxexcBxW5LU60bicSxCb9JFVTTlGccIadQ8bKhr5zY2jNgdLlqV2pLczpO0t1d1JgYvlGP-g9Bn1PlTKcEtBjl-Zl3Je3rmxwvHeHs2ylv6sIFa8DA May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Domain-Id: None May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Domain-Name: None May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Name: admin May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Role: admin,reader,member May 31 18:18:12.257483 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Roles: admin,reader,member May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d50faa712b7648baa5d54974b81b7361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant: admin May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User: admin May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Id: de26ccbcde994176a74c04b6bbaf777d May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Name: admin May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: method: > May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: exception: Flavor 42 could not be found. May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: action_args: {'id': '42'} May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:18:12.259050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:12.260050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:12.261406 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-9e47f55e-0758-448e-805b-189d37bdbeca admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:18:12.262590 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-9e47f55e-0758-448e-805b-189d37bdbeca admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015941 May 31 18:18:12.262590 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 22/42] 10.222.0.17 () {60 vars in 1190 bytes} [Tue May 31 18:18:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 18:18:13.165741 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-8a160d62-6c34-498b-b1f0-b0d83babeb69 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:13.166759 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-8a160d62-6c34-498b-b1f0-b0d83babeb69 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 May 31 18:18:13.167155 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 21/43] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:13.371140 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e6d6d8ad-9693-4972-ba96-c26e0ac38768 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:13.376792 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-e6d6d8ad-9693-4972-ba96-c26e0ac38768 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e6d6d8ad-9693-4972-ba96-c26e0ac38768 admin admin] Request method failure captured: May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Accept: application/json May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Connection: keep-alive May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Content-Length: 0 May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Host: 10.222.0.17 May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABillvlodLcJTkgz5oAb59pwts5VxGl_qEPkh6b7uDHc9XrCDSBneLZii8yFQpiOoIcSr8VMhOubU8PChLwWDm322ks2eR0hnYOb3v0s9v7sXJtG8b1ZA85B4703cqWtRuZ4aa7RrYskt5UaVfFGcERF_QKyKh8ShWssOpHfUysbZyYlRY May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Domain-Id: None May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Domain-Name: None May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Name: admin May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Role: admin,reader,member May 31 18:18:13.378876 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Roles: admin,reader,member May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d50faa712b7648baa5d54974b81b7361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant: admin May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User: admin May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Id: de26ccbcde994176a74c04b6bbaf777d May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Name: admin May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: method: > May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: exception: Flavor 84 could not be found. May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: action_args: {'id': '84'} May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:18:13.380227 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:13.381006 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:13.382300 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e6d6d8ad-9693-4972-ba96-c26e0ac38768 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:18:13.383372 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-e6d6d8ad-9693-4972-ba96-c26e0ac38768 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.069053 May 31 18:18:13.383372 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 23/44] 10.222.0.17 () {60 vars in 1190 bytes} [Tue May 31 18:18:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 18:18:13.390808 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-7fa218fc-efd6-4e8d-8f8e-9eae41710072 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:13.405159 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-7fa218fc-efd6-4e8d-8f8e-9eae41710072 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017935 May 31 18:18:13.405727 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 22/45] 10.222.0.17 () {60 vars in 1210 bytes} [Tue May 31 18:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:18:13.417785 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3c23f2a9-79a5-4706-b8d9-1dc244a55fdc admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:13.433126 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3c23f2a9-79a5-4706-b8d9-1dc244a55fdc admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018819 May 31 18:18:13.433699 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 24/46] 10.222.0.17 () {60 vars in 1210 bytes} [Tue May 31 18:18:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:18:13.451413 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0f655831-0587-4851-a0fe-c87b3ab95197 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:13.457075 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-0f655831-0587-4851-a0fe-c87b3ab95197 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0f655831-0587-4851-a0fe-c87b3ab95197 admin admin] Request method failure captured: May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Accept: application/json May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Connection: keep-alive May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Content-Length: 0 May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Host: 10.222.0.17 May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABillvlodLcJTkgz5oAb59pwts5VxGl_qEPkh6b7uDHc9XrCDSBneLZii8yFQpiOoIcSr8VMhOubU8PChLwWDm322ks2eR0hnYOb3v0s9v7sXJtG8b1ZA85B4703cqWtRuZ4aa7RrYskt5UaVfFGcERF_QKyKh8ShWssOpHfUysbZyYlRY May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Domain-Id: None May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Domain-Name: None May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Name: admin May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member May 31 18:18:13.458606 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d50faa712b7648baa5d54974b81b7361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant: admin May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User: admin May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Id: de26ccbcde994176a74c04b6bbaf777d May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Name: admin May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: method: > May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: exception: Flavor 84 could not be found. May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: action_args: {'id': '84'} May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:18:13.460157 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:13.461045 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:13.462278 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-0f655831-0587-4851-a0fe-c87b3ab95197 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:18:13.463269 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-0f655831-0587-4851-a0fe-c87b3ab95197 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013712 May 31 18:18:13.463269 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 23/47] 10.222.0.17 () {60 vars in 1190 bytes} [Tue May 31 18:18:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 18:18:14.343016 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3c23f2a9-79a5-4706-b8d9-1dc244a55fdc admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:14.344023 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3c23f2a9-79a5-4706-b8d9-1dc244a55fdc admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 31 18:18:14.344547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 25/48] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:14.539244 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-75a6a2c6-0e11-43ce-b7f6-6b5b32f55f6d admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:14.545142 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.wsgi [None req-75a6a2c6-0e11-43ce-b7f6-6b5b32f55f6d admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-75a6a2c6-0e11-43ce-b7f6-6b5b32f55f6d admin admin] Request method failure captured: May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Accept: application/json May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Accept-Encoding: gzip, deflate May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Connection: keep-alive May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Content-Length: 0 May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Host: 10.222.0.17 May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Openstack-Api-Version: compute 2.90 May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Openstack-System-Scope: None May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: User-Agent: python-novaclient May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Auth-Token: gAAAAABillvm5lpUi4BI9P_GzGEFiTVQfmHLN_u_oFtyNT1doagALoqykm7wwTtjvsffrEvy8Hoy6J7eKZ70WcuvJaFgxH14filJ3eK96p503Cfc4aei8P-taNkAgR7z06oYX8t5VOb1XNBCeE7dGcKr-k38BPT7W18Kklrz3eq4loLLyT2F4kM May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Domain-Id: None May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Domain-Name: None May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Identity-Status: Confirmed May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Is-Admin-Project: True May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Openstack-Nova-Api-Version: 2.90 May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Id: default May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Domain-Name: Default May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Project-Name: admin May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Role: admin,reader,member May 31 18:18:14.546665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Roles: admin,reader,member May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d50faa712b7648baa5d54974b81b7361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant: admin May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-Tenant-Name: admin May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User: admin May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Id: default May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Domain-Name: Default May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Id: de26ccbcde994176a74c04b6bbaf777d May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: X-User-Name: admin May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: method: > May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: exception: Flavor 451 could not be found. May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: action_args: {'id': '451'} May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:18:14.548370 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:14.551004 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: ERROR nova.api.openstack.wsgi May 31 18:18:14.552144 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-75a6a2c6-0e11-43ce-b7f6-6b5b32f55f6d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103171) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:18:14.553206 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-75a6a2c6-0e11-43ce-b7f6-6b5b32f55f6d admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062655 May 31 18:18:14.553206 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 24/49] 10.222.0.17 () {60 vars in 1193 bytes} [Tue May 31 18:18:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 18:18:14.558515 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-b211978e-aa50-4fde-a19d-d012c3582dd6 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:14.573579 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-b211978e-aa50-4fde-a19d-d012c3582dd6 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018563 May 31 18:18:14.574132 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 26/50] 10.222.0.17 () {60 vars in 1210 bytes} [Tue May 31 18:18:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:18:14.584206 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:14.598523 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018275 May 31 18:18:14.599080 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 25/51] 10.222.0.17 () {60 vars in 1210 bytes} [Tue May 31 18:18:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:18:14.608517 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-f863f614-fd36-4f08-a3fb-7b59d420b369 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:14.614581 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.wsgi [None req-f863f614-fd36-4f08-a3fb-7b59d420b369 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-f863f614-fd36-4f08-a3fb-7b59d420b369 admin admin] Request method failure captured: May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Accept: application/json May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Accept-Encoding: gzip, deflate May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Connection: keep-alive May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Content-Length: 0 May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Host: 10.222.0.17 May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Openstack-Api-Version: compute 2.90 May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Openstack-System-Scope: None May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: User-Agent: python-novaclient May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Auth-Token: gAAAAABillvm5lpUi4BI9P_GzGEFiTVQfmHLN_u_oFtyNT1doagALoqykm7wwTtjvsffrEvy8Hoy6J7eKZ70WcuvJaFgxH14filJ3eK96p503Cfc4aei8P-taNkAgR7z06oYX8t5VOb1XNBCeE7dGcKr-k38BPT7W18Kklrz3eq4loLLyT2F4kM May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Domain-Id: None May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Domain-Name: None May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Identity-Status: Confirmed May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Is-Admin-Project: True May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Openstack-Nova-Api-Version: 2.90 May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Domain-Id: default May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Domain-Name: Default May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Project-Name: admin May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Role: admin,reader,member May 31 18:18:14.616153 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Roles: admin,reader,member May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d50faa712b7648baa5d54974b81b7361"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d50faa712b7648baa5d54974b81b7361"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant: admin May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant-Id: d50faa712b7648baa5d54974b81b7361 May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-Tenant-Name: admin May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User: admin May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Domain-Id: default May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Domain-Name: Default May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Id: de26ccbcde994176a74c04b6bbaf777d May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: X-User-Name: admin May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: method: > May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: exception: Flavor 451 could not be found. May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: action_args: {'id': '451'} May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:18:14.617677 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:14.618547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: ERROR nova.api.openstack.wsgi May 31 18:18:14.619575 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-f863f614-fd36-4f08-a3fb-7b59d420b369 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103170) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:18:14.620738 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-f863f614-fd36-4f08-a3fb-7b59d420b369 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012619 May 31 18:18:14.620738 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 27/52] 10.222.0.17 () {60 vars in 1193 bytes} [Tue May 31 18:18:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 18:18:15.524448 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:15.525465 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 31 18:18:15.525862 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 26/53] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:15.722767 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-1ab669fd-256f-4f60-a15c-73e6d49d6155 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:18:15.740594 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-1ab669fd-256f-4f60-a15c-73e6d49d6155 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074757 May 31 18:18:15.741154 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 28/54] 10.222.0.17 () {64 vars in 1235 bytes} [Tue May 31 18:18:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:18:16.626970 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:16.628079 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 May 31 18:18:16.628505 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 27/55] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:16.818584 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-2ce35cc2-ba29-4692-bf3e-1b26cf27e642 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:18:16.836140 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-2ce35cc2-ba29-4692-bf3e-1b26cf27e642 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.071527 May 31 18:18:16.836623 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 29/56] 10.222.0.17 () {64 vars in 1235 bytes} [Tue May 31 18:18:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:18:17.728665 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:17.730205 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 May 31 18:18:17.730623 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 28/57] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:17.926185 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-a5b887ba-0611-4258-b8d1-6005dedab663 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:18:17.943583 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-a5b887ba-0611-4258-b8d1-6005dedab663 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.072309 May 31 18:18:17.944049 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 30/58] 10.222.0.17 () {64 vars in 1235 bytes} [Tue May 31 18:18:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:18:18.865733 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:18.866758 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 31 18:18:18.867163 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 29/59] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:19.062618 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5bfe87f9-25ff-44c1-afcb-5810cd1a0256 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:18:19.080850 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5bfe87f9-25ff-44c1-afcb-5810cd1a0256 admin admin] 10.222.0.17 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.071164 May 31 18:18:19.081699 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 31/60] 10.222.0.17 () {64 vars in 1235 bytes} [Tue May 31 18:18:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:18:19.980995 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:19.982007 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 31 18:18:19.982404 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 30/61] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:18:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:18:20.179177 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-3a60418d-f1a6-4107-901d-4eccd2ad8dc3 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:18:20.200789 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-3a60418d-f1a6-4107-901d-4eccd2ad8dc3 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.077907 May 31 18:18:20.201240 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 32/62] 10.222.0.17 () {60 vars in 1202 bytes} [Tue May 31 18:18:20 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:19:22.977980 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:19:22.979003 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-223919ce-63c0-421a-8b47-c9081600b0c1 admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 31 18:19:22.979406 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 31/63] 10.222.0.17 () {54 vars in 930 bytes} [Tue May 31 18:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:19:22.986940 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:19:23.054572 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-1770095a-aa16-4076-b4b4-215454bc1239 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:19:23.075256 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-1770095a-aa16-4076-b4b4-215454bc1239 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.089708 May 31 18:19:23.075818 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 33/64] 10.222.0.17 () {60 vars in 1291 bytes} [Tue May 31 18:19:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:19:23.097271 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG dbcounter [-] [103171] Writing DB stats nova_api:SELECT=14 {{(pid=103171) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:19:23.101190 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-ba2dc13a-a1b1-4e2c-8dff-81a26640297e admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:19:23.109630 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-ba2dc13a-a1b1-4e2c-8dff-81a26640297e admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013740 May 31 18:19:23.110378 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 32/65] 10.222.0.17 () {60 vars in 1282 bytes} [Tue May 31 18:19:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:19:23.122355 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-78fed7d7-4045-4dec-a64c-d8e33955a431 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:19:23.131451 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-78fed7d7-4045-4dec-a64c-d8e33955a431 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012596 May 31 18:19:23.132019 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 34/66] 10.222.0.17 () {60 vars in 1285 bytes} [Tue May 31 18:19:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:19:23.145537 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:19:23.155088 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014342 May 31 18:19:23.155653 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 33/67] 10.222.0.17 () {60 vars in 1285 bytes} [Tue May 31 18:19:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:19:23.168055 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-272cf9e7-2fc7-416d-9a40-6ca25da8b8e4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:19:23.176500 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-272cf9e7-2fc7-416d-9a40-6ca25da8b8e4 admin admin] 10.222.0.17 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012099 May 31 18:19:23.177050 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 35/68] 10.222.0.17 () {60 vars in 1282 bytes} [Tue May 31 18:19:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:22:44.913512 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:44.914583 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 May 31 18:22:44.914934 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 34/69] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:22:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:22:45.082240 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=6 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:22:45.198698 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-5d46f296-0041-468c-84bf-6aad8abbecb4 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:45.199847 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:22:45.199847 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: warnings.warn(msg) May 31 18:22:45.201110 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-5d46f296-0041-468c-84bf-6aad8abbecb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:45.201547 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-5d46f296-0041-468c-84bf-6aad8abbecb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:45.202317 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-5d46f296-0041-468c-84bf-6aad8abbecb4 admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:45.202743 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-5d46f296-0041-468c-84bf-6aad8abbecb4 admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:45.236279 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-5d46f296-0041-468c-84bf-6aad8abbecb4 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.155539 May 31 18:22:45.236862 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 36/70] 10.222.0.17 () {60 vars in 1193 bytes} [Tue May 31 18:22:45 2022] GET /compute/v2.1/os-services => generated 794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:22:46.204300 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:46.205321 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 31 18:22:46.205722 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 35/71] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:22:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:22:46.412743 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-e0ef7d76-6a22-410a-ba53-33ad93497717 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:46.413841 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:22:46.413841 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: warnings.warn(msg) May 31 18:22:46.415022 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-e0ef7d76-6a22-410a-ba53-33ad93497717 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:46.416253 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-e0ef7d76-6a22-410a-ba53-33ad93497717 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:46.417004 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-e0ef7d76-6a22-410a-ba53-33ad93497717 admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:46.417431 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-e0ef7d76-6a22-410a-ba53-33ad93497717 admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:46.443567 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-e0ef7d76-6a22-410a-ba53-33ad93497717 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.096304 May 31 18:22:46.444374 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 37/72] 10.222.0.17 () {60 vars in 1193 bytes} [Tue May 31 18:22:46 2022] GET /compute/v2.1/os-services => generated 794 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:22:57.755177 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:57.756228 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 May 31 18:22:57.756635 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 36/73] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:22:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:22:57.911035 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell0:SELECT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:22:57.911739 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_cell1:SELECT=4 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:22:57.912405 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG dbcounter [-] [103170] Writing DB stats nova_api:SELECT=8 {{(pid=103170) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:22:57.966075 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-c66310e1-c2fd-4560-a3ab-015157048820 admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:57.967198 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:22:57.967198 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: warnings.warn(msg) May 31 18:22:57.968368 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-c66310e1-c2fd-4560-a3ab-015157048820 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:57.968803 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-c66310e1-c2fd-4560-a3ab-015157048820 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:57.969577 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-c66310e1-c2fd-4560-a3ab-015157048820 admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:57.970001 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-c66310e1-c2fd-4560-a3ab-015157048820 admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:57.996007 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-c66310e1-c2fd-4560-a3ab-015157048820 admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.089687 May 31 18:22:57.996614 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 38/74] 10.222.0.17 () {60 vars in 1193 bytes} [Tue May 31 18:22:57 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:22:58.905794 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: DEBUG nova.api.openstack.wsgi [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] Calling method '>' {{(pid=103171) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:58.906799 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: INFO nova.api.openstack.requestlog [None req-df6e7cd5-b54d-4103-93ac-65c37f670daa admin admin] 10.222.0.17 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 May 31 18:22:58.907201 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: [pid: 103171|app: 0|req: 37/75] 10.222.0.17 () {56 vars in 1074 bytes} [Tue May 31 18:22:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:22:59.110070 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG nova.api.openstack.wsgi [None req-b322bb8f-1414-4796-b206-3bdd11476e6e admin admin] Calling method '>' {{(pid=103170) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:22:59.111234 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 18:22:59.111234 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: warnings.warn(msg) May 31 18:22:59.112460 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-b322bb8f-1414-4796-b206-3bdd11476e6e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:59.112899 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-b322bb8f-1414-4796-b206-3bdd11476e6e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:59.113735 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-b322bb8f-1414-4796-b206-3bdd11476e6e admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:22:59.114110 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: DEBUG oslo_concurrency.lockutils [None req-b322bb8f-1414-4796-b206-3bdd11476e6e admin admin] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103170) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:22:59.137078 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: INFO nova.api.openstack.requestlog [None req-b322bb8f-1414-4796-b206-3bdd11476e6e admin admin] 10.222.0.17 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.087340 May 31 18:22:59.137643 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: [pid: 103170|app: 0|req: 39/76] 10.222.0.17 () {60 vars in 1193 bytes} [Tue May 31 18:22:59 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:23:57.641234 dv-cinder-839793-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 31 18:23:57.642139 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: Tue May 31 18:23:57 2022 - graceful shutdown triggered... May 31 18:23:57.642592 dv-cinder-839793-15-iscsi devstack@n-api.service[103170]: Gracefully killing worker 1 (pid: 103170)... May 31 18:23:57.642940 dv-cinder-839793-15-iscsi devstack@n-api.service[103171]: Gracefully killing worker 2 (pid: 103171)... May 31 18:23:58.642998 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: worker 1 buried after 1 seconds May 31 18:23:58.642998 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: worker 2 buried after 1 seconds May 31 18:23:58.642998 dv-cinder-839793-15-iscsi devstack@n-api.service[103169]: goodbye to uWSGI. May 31 18:23:58.644559 dv-cinder-839793-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 31 18:23:58.645135 dv-cinder-839793-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 31 18:23:58.647908 dv-cinder-839793-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 18:23:58.668535 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 18:23:58 2022] *** May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: nodename: dv-cinder-839793-15-iscsi May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: machine: x86_64 May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: clock source: unix May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: pcre jit disabled May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: detected number of CPU cores: 4 May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: current working directory: / May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: detected binary path: /usr/bin/uwsgi-core May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: your processes number limit is 47680 May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: your memory page size is 4096 bytes May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: detected max file descriptor number: 2048 May 31 18:23:58.691629 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: lock engine: pthread robust mutexes May 31 18:23:58.692815 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: thunder lock: enabled May 31 18:23:58.692815 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 18:23:58.692815 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 18:23:58.739208 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: Python main interpreter initialized at 0x55f25ffca9c0 May 31 18:23:58.739208 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: python threads support enabled May 31 18:23:58.739208 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: your server socket listen backlog is limited to 100 connections May 31 18:23:58.739208 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: your mercy for graceful operations on workers is 90 seconds May 31 18:23:58.739667 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: mapped 403077 bytes (393 KB) for 2 cores May 31 18:23:58.739667 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: *** Operational MODE: preforking *** May 31 18:23:58.739920 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: *** uWSGI is running in multiple interpreter mode *** May 31 18:23:58.739920 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: spawned uWSGI master process (pid: 117572) May 31 18:23:58.740174 dv-cinder-839793-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 18:23:58.741314 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: spawned uWSGI worker 1 (pid: 117589, cores: 1) May 31 18:23:58.741314 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: spawned uWSGI worker 2 (pid: 117590, cores: 1) May 31 18:23:58.741314 dv-cinder-839793-15-iscsi devstack@n-api.service[117572]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 18:24:00.028239 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 18:24:00.067827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 18:24:00.898363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:24:00.898363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: from cryptography.utils import int_from_bytes May 31 18:24:00.898954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:24:00.898954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: from cryptography.utils import int_from_bytes May 31 18:24:00.967681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:24:00.967681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: from cryptography.utils import int_from_bytes May 31 18:24:00.968020 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 18:24:00.968020 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: from cryptography.utils import int_from_bytes May 31 18:24:03.395257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 18:24:03.395859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 18:24:03.396146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 18:24:03.396448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 18:24:03.396711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 18:24:03.397111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.397447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.397777 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.398107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.398444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.398764 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.399095 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.399423 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.399805 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.400066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.400709 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.401052 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-15-iscsi {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.401385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.401703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.402023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.402350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.402662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.402992 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.403304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.403812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.405201 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.405201 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.405201 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.405606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.405840 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.406158 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.406487 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.406811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.407136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.407453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.407868 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-15-iscsi {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.408227 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.408536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.408855 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.409285 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.409606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.409932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.410260 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.410591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.410905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.411238 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.411563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.411891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.412242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.412805 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.413152 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.413444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.413770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.414082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.414392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.414646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.414961 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.415818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.416391 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.416817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.417082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.417339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.417672 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.418002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.418324 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.418642 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.418957 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.419276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.419611 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.419904 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.420242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.420561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.420888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.421210 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.421542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.421858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.422184 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.422603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.422859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.423289 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.423563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.423893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.424337 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.424631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.424962 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.425278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.425596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.425907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.426234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.426581 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.426895 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.427145 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.427458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.427769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.428131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.428431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.428771 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.429111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.429537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.429877 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.430153 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.430468 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.430842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.431681 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.431946 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.432279 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.432590 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.432902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.433230 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.433559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.433876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.434184 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.434497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.434809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.435140 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.435448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.435769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.436283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.436455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.436716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.437042 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.437353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.437666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.437989 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.438304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.438629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.439470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.439470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.439817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.439817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.440195 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.440572 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.440762 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.441096 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.441383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.441689 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.442015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.442349 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.442662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.443104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.443383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.443579 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.443977 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.444290 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.444646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.444968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.445311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.445649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.445976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.446307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.446307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.447018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.447278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.447601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.447918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.448270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.448599 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.448934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.449257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.449582 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.449908 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.450224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.450701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.450870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.451228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.451508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.451856 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.452225 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.452548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.452973 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.453209 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.453500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.453813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.454176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.454608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.454843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.455067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.455393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.455708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.456026 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.456494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.456812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.457136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.457479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.457798 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.458121 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.458437 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.458761 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.459078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.459392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.459707 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.460018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.460362 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.460684 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.460998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.461305 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.461631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.461990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.462353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.462956 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.463281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.463604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.463923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.464271 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.464585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.464905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.465223 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.465535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.465865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.466183 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.466494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.466826 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.467137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.467449 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.467775 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.468169 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.468426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.468751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.469067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.469400 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.469720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.470037 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.470388 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.470721 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.471031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.471360 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.471690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.472008 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.472365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.472681 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.472989 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.473295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.473603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.473916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.474222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.474530 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.474838 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.475146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.475453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.475782 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.476253 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.476499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.476732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.477019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.477371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.478200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.478547 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.478891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.479219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.479550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.479868 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.480213 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.480531 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.480855 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.481174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.481489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.481821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.485875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.486919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.487160 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.487698 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.487869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.488045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.488459 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.488745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.488988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 18:24:03.488988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 18:24:03.490002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.490002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.490301 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 18:24:03.490446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.490446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.490679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 18:24:03.490679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 18:24:03.490923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.490923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.491200 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.491313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.491459 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.491597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.491737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.491917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.492055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.492214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.492344 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.492500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.492637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.492784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.492926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.493067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.493221 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.493947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.494094 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.494259 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.494417 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.494574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.494718 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.494866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.495037 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.495209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-839793-15-iscsi {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.495479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.495633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.495777 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.495930 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.496034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.496146 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.496244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.496382 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.497063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.497267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.497419 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.497585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.497731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.497874 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.498008 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.498141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.498299 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.498448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.498607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.498755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.498893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.499055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.499226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.499377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.499480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.499559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.499648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.499738 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.499830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.499915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.499983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.500155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.500353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.500494 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.500643 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.500772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.500896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.501143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.501246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-839793-15-iscsi {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.501474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.501735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.501826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.502065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.502162 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.502393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.502492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.502711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.502808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.503032 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.503129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.503348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.503450 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.503665 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.503796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.503988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.504080 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.504333 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.504434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.504648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.504737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.504964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.505053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.505283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.505380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.505588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.505695 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.505898 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.506002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.506211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.506302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.506525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.506612 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.506866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.506997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.507201 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.507559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.507651 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.507739 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.507930 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.508029 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.508281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.508382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.508604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.508954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.509048 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.509381 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.509479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.509711 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.509959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.510048 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.510354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.510597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.510700 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.510814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.510951 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.511046 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.511260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.511352 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.511567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.511658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.511875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.511972 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.512214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.512327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.512526 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.512626 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.512833 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.512930 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.513154 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.513251 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.513474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.513578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.513785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.513874 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.514092 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.514188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.514398 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.514512 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.514711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.514799 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.17 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.515018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.515100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.17 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.515325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.515411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.515699 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.515791 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.515933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.516012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.516278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.516387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.516588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.516690 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.516918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.517012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.517211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.517327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.517528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.517617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.517835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.517935 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.518139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.518235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.518446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.518542 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.518752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.518855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.519003 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.519092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.519305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.519395 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.522350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.522509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.522601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.522680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.522875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.522973 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.523066 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.523193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.523281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.523402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.523483 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.523574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.523671 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.523867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.523969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.524054 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.524179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.524314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.524505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.524629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.524726 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.524832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.524945 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.525066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.525167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.525252 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.525341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.525419 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.525501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.525588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.525684 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.525790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.525881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.525881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526236 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526318 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526551 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526696 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526855 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.526922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.526996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.527238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.527335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.527551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.527644 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.527863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.527947 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.528199 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.528360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.528507 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.528605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.528813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.528909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.529118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.529208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.529419 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.529516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.529727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.529815 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.530036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.530132 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.530342 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.530431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.530647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.530736 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.530953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.531050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.531259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.531357 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.531565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.531652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.531867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.531964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.532197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.532290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.532507 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.532604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.532821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.532923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.533147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.533245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.533465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.533563 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.533773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.533871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.534078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.534176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.534383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.534479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.534691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.534789 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 18:24:03.534998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.535095 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.535310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.535399 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.535613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.535711 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.535919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536555 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.536957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.537204 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.537302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.537500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.537590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.537807 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.537907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.538114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.538211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.538420 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.538509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.538755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.538842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.539065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.539178 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.539379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.539479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.539709 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.539875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.540034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.540753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.540880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.541024 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.541207 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.541525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.541630 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.541848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.541938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.542159 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.542259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.542744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.542872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.542960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.543049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.543139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.543229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.543476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.543689 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.543831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544050 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544328 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544490 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.544992 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.545117 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.545289 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.545444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.545604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.545772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.545921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.546081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.546247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.546397 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.546588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.546711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.546961 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.547065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.547373 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.547536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.547654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.547744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.547828 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549148 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549328 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549483 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549572 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.549902 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550499 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550499 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550665 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.550898 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.551026 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.551393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.551483 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.551703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.551965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.552055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.552329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.552541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.552643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.553047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.553147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.553403 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.553577 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.553760 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.554098 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.554188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.554438 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.554649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.554765 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.555078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.555364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.555454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.555678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.556545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.556667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.557080 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.557225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.557599 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.557888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558133 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.558901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.559137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.559319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.559458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.559558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.559875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.559990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.560129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.560240 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.560431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.560566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.560747 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.560889 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.561062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.561212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.561379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.561512 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.561706 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.561830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.562023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.562163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.562339 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.562482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.562678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.562771 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563043 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563303 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563628 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.563955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.564045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.564301 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.564486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.564601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.564778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.564945 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.565089 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.565189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.565492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.565595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.565797 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.565900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.566109 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.566207 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.566413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.566585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.566718 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.566888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567327 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567419 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567632 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567729 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.567962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.568194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.568307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.568475 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.568621 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.568756 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.568925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569230 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.569972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.570195 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.570287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.570515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.570614 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.570852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.571046 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.571167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.571267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.571516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.571688 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.571937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.572040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.572335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.572546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.572800 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.572905 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573049 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573223 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573684 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.573996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.574126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.574307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.574449 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.574639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.574761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.574951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.575089 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.575267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.575401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.575582 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.575724 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.575897 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.576031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.576231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.576377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.576538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.576719 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.576863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.577055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.577181 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.577376 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.577469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.577699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.577841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578339 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578441 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578748 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.578956 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579579 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579897 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.579987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.580232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.580329 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.580552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.580644 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.580862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.580951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.581183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.581281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.581495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.581636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.581815 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.581913 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.582195 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.582310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.582435 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.582533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.582764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.582870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.583099 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.583245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.583490 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.583590 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.583707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.583807 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.584987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.585097 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.585285 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.585383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.585588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.585692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.585902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586208 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586819 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.586919 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.587800 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.587958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.588178 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.588370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.588564 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.588734 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.588838 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.589062 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.589227 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.589379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.589503 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.589691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.589789 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.590000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.590097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.590320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.590412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.590644 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.590745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591468 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.591987 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592164 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592303 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.592932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.593163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.593277 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.593392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.593569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.593699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.593885 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594211 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594339 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594534 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594650 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.594953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.595176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.595268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.595497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.595597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.595817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.595909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.596165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.596261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.596493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.596749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.596850 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.597089 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.597188 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.597403 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.597501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.597719 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.597817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598445 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.598973 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599413 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599904 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.599994 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.600263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.600510 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.600668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.600843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.600978 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.601160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.601303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.601472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.601624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.601789 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.601937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.602090 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.602218 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.602407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.603317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.603422 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.603683 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.603832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.603985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.604327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.604431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.604649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.604758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.604963 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.605061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.605277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.605377 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.605596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.605704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.605905 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606697 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606851 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.606999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607095 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607682 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.607985 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.608075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.608331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.608464 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.608638 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.608751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.608958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.609072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.609260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.609350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.609583 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.609680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.609894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.610175 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.610267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.610487 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.610576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.610791 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.610881 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.611135 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.611234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.611441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.611531 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.611779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.611885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.612119 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.612213 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.612453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.612558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.612756 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.612846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.613061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.613158 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.613394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.613562 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.613732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.613891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614425 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614579 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614846 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.614977 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.615142 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.615247 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.615453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.615541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.615761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.616032 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.616137 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.616409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.616491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.616712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.616804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617028 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617182 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617336 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617754 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.617920 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.618067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.618257 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.618406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.618639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.618776 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.619066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.619250 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.619401 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.619551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.619687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.619879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620033 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.620987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.621151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.621303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.621468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.621621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.621760 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.621919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.622072 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.622228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.622391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.622539 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.622690 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.622861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.623013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.623142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.623278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.623442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.623696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.623912 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.624079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.624311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.624464 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.624620 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.624790 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.624959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625285 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.625981 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626156 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626249 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626497 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.626907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627215 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.627917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.628137 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.628234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.628462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.628554 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.628765 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.628906 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.629104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.629240 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.629397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.629522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.629701 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.629820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.630003 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.630128 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.630306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.630613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.630714 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.630944 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.631041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.631272 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.631362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.631594 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.631691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.631907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.632005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.632511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.632621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.632830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.632929 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.633138 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.633231 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.633449 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.633545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.633754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.633878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.634105 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.634197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.634528 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.634647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.634866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.635112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.635214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.635426 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.635564 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.635737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.635868 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.636065 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.636291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.636402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.636493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.636715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.636808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637030 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637121 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637438 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637660 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637751 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.637962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638093 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638274 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638683 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.638999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.639208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.639310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.639517 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.639608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.639828 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.639923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.640163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.640314 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.640477 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.640569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.640788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.640879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.641094 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.641194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.641401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.641500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.641712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.641809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642128 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642460 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.642962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.643108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.643265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.643440 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.643574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.643753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.643883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.644163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.644326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.644508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.644717 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.644872 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.645041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.645194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.645345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.645508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.645656 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.645907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.646116 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.646274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.646491 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.646662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.646825 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647118 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647289 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.647808 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648017 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648361 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.648978 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.649070 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.649281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.649415 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.650156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.650250 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.650561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.650724 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.650900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.651199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.651382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.651514 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.651703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.651824 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652178 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652476 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652686 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.652999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.653209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.653308 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.653525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.653621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.653832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.653923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.654200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.654304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.654509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.654611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.654823 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.654916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.655126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.655219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.655436 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.655528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.655776 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.655912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.656080 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.656221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.656416 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.656573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.656729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.656829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.657052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.657142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.657378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.657477 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.657694 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.657784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658333 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.658948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.659038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.659266 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.659370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.659588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.659679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.660070 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.660263 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.660552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.660695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.660881 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661016 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661573 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.661969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.662910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663052 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663242 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.663913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.664040 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.664243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.664395 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.664530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.664686 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.664843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.665024 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.665765 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.665922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.666174 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.666341 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.666631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.666784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.666943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.667100 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.667280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.667438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.667608 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.667744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.667921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.668064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.668323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.668467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.668602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.668745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.668900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.669044 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.669197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.669387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.669550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.669755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.669895 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.670090 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.670252 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.670401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.670555 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.670775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.670940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.671110 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.671266 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.671432 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 18:24:03.671595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.671747 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.671987 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.672330 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.672655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.672983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.673291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.673597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.673909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.674216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.674522 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.674826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.675129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.675432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.675735 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.676040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.676391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.676696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.677019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.677330 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.677638 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.677942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.678247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.678595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.678910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.679246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.679569 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.679893 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.680249 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.680563 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.681071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.681627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.682077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.682402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.682724 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.683046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.683367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.683686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.684004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.684352 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.684669 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.685083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.685615 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.685893 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.686209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.686526 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.686843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.687159 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.687476 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.687792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.688163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.688439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.689023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.689180 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.691323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.691323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.691323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.691323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.691323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.694063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.696739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.699899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.700503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.700829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.701174 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.701504 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.701834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.702159 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.702481 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.702815 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.703122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.703433 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.703745 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.704055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.704390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.704713 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.705027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.705333 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.705654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.705966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.706502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.706853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.707171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.707503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.707826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.708247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.708563 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.708896 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.709203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.709511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.709828 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.710139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.710445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.710752 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.711064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.711374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.711679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.712835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.712967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.713512 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.713837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.714152 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.714458 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.714775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.715084 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.715393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.715700 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.716007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.716367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.716679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.716994 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.717301 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.717615 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.717923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.718234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.718602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.718931 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.719238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.719549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.719872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.720208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.720535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.720848 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.721162 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.721515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.721835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.722406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.722743 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.723067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.723407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.723739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.724050 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.724396 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.724703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.725029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.725341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.725653 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.725964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.726274 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.726583 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.726891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.727201 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.727512 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.728765 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.729229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.729577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.729898 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.730221 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.730544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.730894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.731219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.731542 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.731863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.732222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.732540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.732857 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.733171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.733489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.733819 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.734153 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.734337 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO dbcounter [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Registered counter for database nova_api May 31 18:24:03.734517 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.734766 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.735196 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.735513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.735839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.736190 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.736508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.736834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.737160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.737476 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.737800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.738115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.738449 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.738795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.739127 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.739455 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.739764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.740078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.740407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.740720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.741041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.741357 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.741659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.741969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.742281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.742585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.742889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.743282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.743732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.744322 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.744746 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.745062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.745377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.745688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.745999 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.746309 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.746625 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.746934 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.747242 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.747548 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.747858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.748197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.748539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.748879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.749203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.749927 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.750265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.750593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.750906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.751251 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.751560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.751885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.752224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.752566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.752881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.753197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.753521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.753829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.754143 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.754459 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.754794 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.755053 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_db.sqlalchemy.engines [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:03.755235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.755413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.755740 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.756062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.756419 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.756737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.757051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.757639 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.757953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.758266 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.758583 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.758989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.759531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.760007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.760364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.760702 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.761032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.761347 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.761678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.762011 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.762365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.762681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.763033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.763268 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writer thread running {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:03.763463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.763676 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.763995 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.764330 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 18:24:03.764578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 18:24:03.823870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.context [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e77dd333-c7fe-440b-84b1-5d076cdc10bf(cell1) {{(pid=117589) load_cells /opt/stack/nova/nova/context.py:464}} May 31 18:24:03.827413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO dbcounter [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Registered counter for database nova_api May 31 18:24:03.828078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:03.829746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:03.830563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:03.832566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:03.834568 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO dbcounter [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Registered counter for database nova_cell0 May 31 18:24:03.839318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO dbcounter [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Registered counter for database nova_cell1 May 31 18:24:03.847624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_db.sqlalchemy.engines [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:03.849210 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_db.sqlalchemy.engines [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:03.850782 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:03.858587 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writer thread running {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:03.860891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writer thread running {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:03.918908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.context [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e77dd333-c7fe-440b-84b1-5d076cdc10bf(cell1) {{(pid=117590) load_cells /opt/stack/nova/nova/context.py:464}} May 31 18:24:03.923111 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:03.924757 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:03.925575 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:03.927558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:03.929769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO dbcounter [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Registered counter for database nova_cell0 May 31 18:24:03.934275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO dbcounter [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Registered counter for database nova_cell1 May 31 18:24:03.942268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:03.945835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:03.956892 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writer thread running {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:03.959990 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writer thread running {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:04.046270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writer thread running {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:04.056346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO dbcounter [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Registered counter for database nova_cell0 May 31 18:24:04.066011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_db.sqlalchemy.engines [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:04.072613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writer thread running {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:04.122721 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO dbcounter [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Registered counter for database nova_cell0 May 31 18:24:04.130133 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_db.sqlalchemy.engines [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 18:24:04.136237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writer thread running {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 18:24:04.528283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: WARNING keystonemiddleware.auth_token [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:24:04.536447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: WARNING keystonemiddleware.auth_token [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:24:04.587131 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: WARNING keystonemiddleware.auth_token [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:24:04.598793 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: WARNING keystonemiddleware.auth_token [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:24:04.771088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: WARNING keystonemiddleware.auth_token [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:24:04.777372 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: WARNING keystonemiddleware.auth_token [None req-4e992b72-b523-491e-b3b3-f84e41791a4f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:24:04.782853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f25ffca9c0 pid: 117589 (default app) May 31 18:24:04.835025 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: WARNING keystonemiddleware.auth_token [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 18:24:04.841312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: WARNING keystonemiddleware.auth_token [None req-4fe970b8-c363-47ce-aea4-db20796ca23c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 18:24:04.846480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f25ffca9c0 pid: 117590 (default app) May 31 18:24:47.574383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.577351 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.578913 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.581386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.877092 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.879018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.879814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:47.892728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:24:49.136237 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-19a3d7f0-840f-4e7a-b6cd-36560982c189 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Action: 'create', calling method: .version_select at 0x7ffb7586a310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1225668372"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:24:49.249153 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b28a8ed7-97ee-4454-bd4d-aea555ddd7fd tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Action: 'create', calling method: .version_select at 0x7ffb75869310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-433700697", "metadata": {"Type": "work"}}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:24:50.896236 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-19a3d7f0-840f-4e7a-b6cd-36560982c189 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.336723 May 31 18:24:50.898441 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 1/1] 10.222.0.17 () {60 vars in 1154 bytes} [Tue May 31 18:24:47 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3341 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 18:24:50.914245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b28a8ed7-97ee-4454-bd4d-aea555ddd7fd tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.041613 May 31 18:24:50.915476 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 1/2] 10.222.0.17 () {60 vars in 1155 bytes} [Tue May 31 18:24:47 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3045 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 18:24:50.921401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ca746e86-b2e8-41f5-9d18-9041792584e0 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb75730310>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:51.013319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ca746e86-b2e8-41f5-9d18-9041792584e0 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 200 len: 345 microversion: 2.1 time: 0.096430 May 31 18:24:51.014130 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 2/3] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:50 2022] GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 345 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:51.023676 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-93b534e3-fabd-4204-a66f-e53bfb6d1c02 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb757303a0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:51.120467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-93b534e3-fabd-4204-a66f-e53bfb6d1c02 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.104983 May 31 18:24:51.121075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 3/4] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:51 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:51.234880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-29099740", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "networks": [{"uuid": "2c2af625-c483-45b1-b243-faf5d58831b3"}]}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:24:51.465926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] validate_networks() for [('2c2af625-c483-45b1-b243-faf5d58831b3', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:24:52.030869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-034c8524-ddf3-4988-9261-3c1f438a34c5 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb75730af0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:52.155840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-034c8524-ddf3-4988-9261-3c1f438a34c5 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 200 len: 345 microversion: 2.1 time: 0.132214 May 31 18:24:52.156936 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 4/5] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:52 2022] GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 345 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:52.161819 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e972ebb2-c7f1-4f55-b469-578bae7ee687 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb756c51f0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:52.271208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e972ebb2-c7f1-4f55-b469-578bae7ee687 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.109839 May 31 18:24:52.272312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 5/6] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:52 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:53.168030 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cea3423a-2727-48f3-b476-98d31cc977bb tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb75730d30>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:53.282608 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cea3423a-2727-48f3-b476-98d31cc977bb tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 200 len: 346 microversion: 2.1 time: 0.118343 May 31 18:24:53.283462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 6/7] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:53 2022] GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 346 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:53.288789 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-938e267f-1a24-4463-9f29-a89859f4ea14 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb75730160>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:53.385244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-938e267f-1a24-4463-9f29-a89859f4ea14 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 353 microversion: 2.1 time: 0.100543 May 31 18:24:53.385804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 7/8] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:53 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 353 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:53.390617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cb290c0f-68d8-4e52-b75d-8d63f8672611 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Action: 'create', calling method: .version_select at 0x7ffb756c5700>, body: {"snapshot": {"volume_id": "43714ec4-0f01-497e-b968-c6a0345fb44d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1971622879"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:24:53.763627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cb290c0f-68d8-4e52-b75d-8d63f8672611 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.375777 May 31 18:24:53.768422 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 8/9] 10.222.0.17 () {60 vars in 1161 bytes} [Tue May 31 18:24:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:53.770232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9613a615-3980-4e99-8ef3-9745d0c0fa01 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb757304c0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:53.870664 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:24:53.871146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:24:53.871587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:24:53.871985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:24:53.872437 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:24:53.880835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9613a615-3980-4e99-8ef3-9745d0c0fa01 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 353 microversion: 2.1 time: 0.115191 May 31 18:24:53.881620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 9/10] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:53 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 353 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:53.891627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ec8e6977-4070-45e3-99d8-8e3993964036 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb75730a60>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:53.912652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:53.913948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:53.915109 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:53.915694 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:53.970236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ec8e6977-4070-45e3-99d8-8e3993964036 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.086781 May 31 18:24:53.970853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 10/11] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:53 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:53.976335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Getting quotas for project d51bae70cfe74d2da95b93260c39ffc1. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:24:53.981601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c6b2c752-0c00-40eb-892d-2f1f1778acb7 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb756c5940>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:53.984681 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Getting quotas for user abd536e419a544d895f054c7f6922171 and project d51bae70cfe74d2da95b93260c39ffc1. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:24:53.999714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:24:54.016112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:24:54.131114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c6b2c752-0c00-40eb-892d-2f1f1778acb7 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 202 len: 0 microversion: 2.1 time: 0.152933 May 31 18:24:54.131334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 11/12] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:24:53 2022] DELETE /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:24:54.137155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9f2829b5-aa3d-4bb2-822b-539dee3fec65 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb756c55e0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:54.143242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3618194d-1b5f-4103-8e6e-eb0228d8471b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.243361 May 31 18:24:54.143900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 2/13] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:24:54.159995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-199b727e-a2e7-49a7-97fb-23931d6f261d tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb75642ee0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:54.258708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9f2829b5-aa3d-4bb2-822b-539dee3fec65 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.125757 May 31 18:24:54.265321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 12/14] 10.222.0.17 () {58 vars in 1139 bytes} [Tue May 31 18:24:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:54.266552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-404b8c10-2e3b-4c8f-a018-af2bad73318e tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:54.271634 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-404b8c10-2e3b-4c8f-a018-af2bad73318e tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:24:54.307353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-199b727e-a2e7-49a7-97fb-23931d6f261d tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.162193 May 31 18:24:54.314531 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 3/15] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:54 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:54.319783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a4423d10-3f0f-4e4c-a84c-75598d32af53 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74ddc670>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:54.501198 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a4423d10-3f0f-4e4c-a84c-75598d32af53 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.185513 May 31 18:24:54.502112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 4/16] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:54 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:54.550843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-404b8c10-2e3b-4c8f-a018-af2bad73318e tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:24:54.575541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-404b8c10-2e3b-4c8f-a018-af2bad73318e tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1213 microversion: 2.1 time: 0.313049 May 31 18:24:54.578625 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 13/17] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:24:54 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1213 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:24:55.322060 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a1e075b1-87b5-497d-a36c-e4fc47a4cf3e tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb756429d0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:55.475812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a1e075b1-87b5-497d-a36c-e4fc47a4cf3e tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.158403 May 31 18:24:55.480723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 5/18] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:55 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:55.517919 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5492ea76-c197-4f9b-aef6-335b7947ef97 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb756c5a60>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:55.595733 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-dcce566a-350e-443a-a33f-36e42a1a00e0 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:55.596395 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-dcce566a-350e-443a-a33f-36e42a1a00e0 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:24:55.613727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5492ea76-c197-4f9b-aef6-335b7947ef97 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.104524 May 31 18:24:55.614959 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 14/19] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:55 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:56.184399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-dcce566a-350e-443a-a33f-36e42a1a00e0 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:24:56.214250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-dcce566a-350e-443a-a33f-36e42a1a00e0 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1213 microversion: 2.1 time: 0.624527 May 31 18:24:56.214967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 6/20] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:24:55 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1213 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:24:56.525948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-61a93305-507f-465b-be76-008efa3edcca tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb7569e280>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:56.610813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-61a93305-507f-465b-be76-008efa3edcca tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.125893 May 31 18:24:56.612181 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 15/21] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:56 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:56.627957 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5f764b0d-6caa-494b-9189-b1df162c950d tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74ddc3a0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:56.684687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5f764b0d-6caa-494b-9189-b1df162c950d tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.061668 May 31 18:24:56.689174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 7/22] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:56 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:57.239204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:57.240851 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:24:57.261189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:57.262219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:57.263218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:57.263915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:57.628261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6a9d12c4-825b-4b1e-ace9-c8aa0b33134b tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb74ddcee0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:57.750841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6a9d12c4-825b-4b1e-ace9-c8aa0b33134b tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.130202 May 31 18:24:57.752028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 8/23] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:57 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:57.762473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-061ddada-da34-4146-80e4-5dd103d41293 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74582700>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:57.840601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-061ddada-da34-4146-80e4-5dd103d41293 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.082115 May 31 18:24:57.841323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 9/24] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:57 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:57.936288 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:24:57.968159 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d7633606-3525-4c5d-b527-6ba064570ec8 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1217 microversion: 2.1 time: 0.736923 May 31 18:24:57.981940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 16/25] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:24:57 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1217 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:24:58.773811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-06ea2204-9f8b-4b48-ba5b-f507bc814e68 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb74582dc0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:58.858153 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4269a7e8-de6c-4e9a-997f-f50ad83f98d5 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb75607af0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:58.906314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-06ea2204-9f8b-4b48-ba5b-f507bc814e68 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.137944 May 31 18:24:58.906915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 10/26] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:58 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:58.914598 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4269a7e8-de6c-4e9a-997f-f50ad83f98d5 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.066008 May 31 18:24:58.919504 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 17/27] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:58 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:24:58.994073 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:58.995360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:24:59.003130 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:59.003776 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:59.004750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:24:59.007316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:24:59.139584 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:24:59.150392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f311431a-8d19-4580-8f2b-7599eb9d530a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1217 microversion: 2.1 time: 0.160109 May 31 18:24:59.150979 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 18/28] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:24:58 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1217 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:24:59.195869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cb9aef04-fa09-44dd-b442-bd2b8bbfb77a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: .version_select at 0x7ffb7458c1f0>, body: {"keypair": {"name": "tempest-keypair-539561395", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiAXiVMVNU/Wmp8RL5nQ7VF7aKiXuZzkXFMz9o3+EE7sM+GxBmoz/trpDAVkw+N1jU0/II/wU18M5G2NfZzbXh7FXKfsbv8M6pc8AOjAfBbtEP6HVRmXIKU8cb7MTV2Eg=="}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:24:59.233926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-cb9aef04-fa09-44dd-b442-bd2b8bbfb77a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:24:59.240034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-cb9aef04-fa09-44dd-b442-bd2b8bbfb77a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:24:59.253181 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f788eded-9718-4ee2-bc3f-2ffd54b7ad47 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: .version_select at 0x7ffb75617700>, body: {"keypair": {"name": "tempest-keypair-67692383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGxmRJRcJDubSM6RIg17y45T/bsHEts0eneKv1+VuW7wdKUZhCthMCPU8uRGtG1W6Lx1HhWpiGaIUUILouIfGkUFO8YqAJ/fPV1BgN5zjrgIqCjWxLYsM5b86/Vfu3OIrQ=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:24:59.308595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cb9aef04-fa09-44dd-b442-bd2b8bbfb77a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.318306 May 31 18:24:59.309824 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 11/29] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:24:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:59.388823 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-f788eded-9718-4ee2-bc3f-2ffd54b7ad47 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for project 7ea083067dfc4b6194457652a3501317. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:24:59.400446 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-f788eded-9718-4ee2-bc3f-2ffd54b7ad47 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for user 7c6d1ac15d024f77bb363170ab423c0b and project 7ea083067dfc4b6194457652a3501317. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:24:59.519326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f788eded-9718-4ee2-bc3f-2ffd54b7ad47 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.367029 May 31 18:24:59.520060 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 19/30] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:24:59 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:24:59.920865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e9e652a0-ffac-49b7-89d7-85475912539c tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb7458cee0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:24:59.926816 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b17448e9-ee8d-4694-b7d1-c7fa79abd908 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb755a9700>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:00.010652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b17448e9-ee8d-4694-b7d1-c7fa79abd908 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.088123 May 31 18:25:00.011626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 20/31] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:24:59 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:00.058750 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e9e652a0-ffac-49b7-89d7-85475912539c tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.142458 May 31 18:25:00.059344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 12/32] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:24:59 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:25:00.167505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:00.168448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:00.180486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:00.181327 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:00.184541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:00.185214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:00.378545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:00.394154 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6a69fa38-e749-4d92-bed8-9d3d718ffd9d tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1209 microversion: 2.1 time: 0.229155 May 31 18:25:00.407783 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 21/33] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:00 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:01.026042 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-420b830d-282d-4b4a-8d5f-ec6c6bfe3a9b tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb745ac5e0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:01.072139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9b86863e-671d-4928-821a-53a5b93c89b1 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb755a9b80>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:01.093512 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-420b830d-282d-4b4a-8d5f-ec6c6bfe3a9b tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 288 microversion: 2.1 time: 0.072978 May 31 18:25:01.095250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 13/34] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:25:01 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 288 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:01.104841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-fb114098-346d-4ab9-8dbe-54cecb23f547 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb7458cee0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:01.200697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9b86863e-671d-4928-821a-53a5b93c89b1 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.133050 May 31 18:25:01.201516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 22/35] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:01 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:01.236784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-fb114098-346d-4ab9-8dbe-54cecb23f547 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "DELETE /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 202 len: 0 microversion: 2.1 time: 0.135559 May 31 18:25:01.237648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 14/36] 10.222.0.17 () {58 vars in 1253 bytes} [Tue May 31 18:25:01 2022] DELETE /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:25:01.246596 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fb68ed64-a7db-4943-9b46-a852b9e63e44 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74d63d30>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:01.358678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fb68ed64-a7db-4943-9b46-a852b9e63e44 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.116657 May 31 18:25:01.359925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 23/37] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:25:01 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:01.420581 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:01.425995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:01.434947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:01.436784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:01.441058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:01.441643 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:01.681720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:01.706465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ef9106f7-cbda-4ce9-8f48-c1915636b582 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1265 microversion: 2.1 time: 0.296046 May 31 18:25:01.727067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 15/38] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:01 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:02.213927 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e7a55e3c-b217-4d5d-bcfd-cf410895e437 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb74d63700>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:02.334008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e7a55e3c-b217-4d5d-bcfd-cf410895e437 tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.124778 May 31 18:25:02.345018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 24/39] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:02 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:02.372133 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4803c024-a620-47d4-a845-4a542b38e699 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74525e50>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:02.421446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4803c024-a620-47d4-a845-4a542b38e699 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.053402 May 31 18:25:02.425533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 16/40] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:25:02 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:02.729741 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:02.730906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:02.739620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:02.741334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:02.742576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:02.752910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:03.023894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:03.034777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8db28820-9bac-481b-9c1b-c1f2bc04a66c tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1265 microversion: 2.1 time: 0.311893 May 31 18:25:03.039485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 25/41] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:02 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:03.348066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-76a6f556-d6e9-479e-b486-2468d3b3cb6e tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb74530430>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:03.403375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-76a6f556-d6e9-479e-b486-2468d3b3cb6e tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.059740 May 31 18:25:03.405036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 17/42] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:03 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:03.435233 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5ebe0139-50ef-4ab9-883b-67ab5db0c3fe tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74d63820>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:03.479303 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5ebe0139-50ef-4ab9-883b-67ab5db0c3fe tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.048619 May 31 18:25:03.483615 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 26/43] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:25:03 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:04.052373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:04.058501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:04.059073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:04.074425 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:04.076042 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:04.076890 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:04.077384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:04.353865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:04.362177 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-15c97f31-fcd8-4ae7-9386-5d67117266f1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1265 microversion: 2.1 time: 0.310822 May 31 18:25:04.362785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 18/44] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:04 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:04.417381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-44d3b135-28d5-4008-b9ba-b3bebee57c7f tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb74d75ca0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:04.490709 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6c80e2ab-a02a-4279-b2b9-1474a6c0acc6 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb745ac040>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:04.534844 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6c80e2ab-a02a-4279-b2b9-1474a6c0acc6 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 200 len: 287 microversion: 2.1 time: 0.047642 May 31 18:25:04.536402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 19/45] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:25:04 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:04.542419 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-44d3b135-28d5-4008-b9ba-b3bebee57c7f tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 200 len: 352 microversion: 2.1 time: 0.128265 May 31 18:25:04.543177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 27/46] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:04 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 352 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:25:04.902966 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-662219724", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "900f31eb-512c-4a14-a74f-282a3e50261b"}], "security_groups": [{"name": "tempest-securitygroup--964920474"}], "key_name": "tempest-keypair-539561395", "user_data": "}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:05.380594 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:05.382360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:05.394152 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:05.396069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:05.397324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:05.398013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:05.416886 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] validate_networks() for [('900f31eb-512c-4a14-a74f-282a3e50261b', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:25:05.851677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:05.872406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-41196890-88e0-4dae-9d4a-e34a6f930afe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1271 microversion: 2.1 time: 0.496018 May 31 18:25:05.886466 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 28/47] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:05 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1271 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:05.892398 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e5985ad-0a55-4850-b890-350c35188c54 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74d0c820>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:05.928444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-3e5985ad-0a55-4850-b890-350c35188c54 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] HTTP exception thrown: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e5985ad-0a55-4850-b890-350c35188c54 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Request method failure captured: May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab HTTP/1.1 May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1vYX1yOPjUBPldKd64_V9uY3H9iZXSdGTUdhobe1LGq5mGWCTmnno1d7nUuHfSLtI7kPouNbaIlDZ-XzizW2Pq1w8WlzcGsXwDiuIDj1-XEzAlptjWRqyaV-_pYDD482KyJWWkbW2P23czvaGTXh2SeaeGKEfhP-ykHxGJwKhlHVI May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:25:05.935085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 59b715d3b6024ee7b6ddbfebcbaf4c18 May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '5c6ee2f9-a0a3-4829-b6aa-848256dc06ab'} May 31 18:25:05.936241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. (HTTP 404) (Request-ID: req-4b2963d9-7c01-46ee-8253-98e64e2476cb) May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.937081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:05.937949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 31 18:25:05.939179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. May 31 18:25:05.941808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:05.945221 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e5985ad-0a55-4850-b890-350c35188c54 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Returning 404 to user: Snapshot 5c6ee2f9-a0a3-4829-b6aa-848256dc06ab could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:25:05.946589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3e5985ad-0a55-4850-b890-350c35188c54 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab" status: 404 len: 111 microversion: 2.1 time: 0.058435 May 31 18:25:05.953876 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 29/48] 10.222.0.17 () {58 vars in 1250 bytes} [Tue May 31 18:25:05 2022] GET /compute/v2.1/os-snapshots/5c6ee2f9-a0a3-4829-b6aa-848256dc06ab => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:25:05.960315 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f27ba161-9403-4a9c-af9b-19a01a8fd7eb tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Calling method '.version_select at 0x7ffb760a73a0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:06.003635 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-f27ba161-9403-4a9c-af9b-19a01a8fd7eb tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] HTTP exception thrown: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f27ba161-9403-4a9c-af9b-19a01a8fd7eb tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Request method failure captured: May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 HTTP/1.1 May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1vCCDz3Tb-xZoObwjZv3q2lt9etZjvs_IHZwJWi4O6cB61iofl-2yX4-OcVU9eAKqhkSK3UpEWS8rUiZb58F4nVhwohX-2okEa_FpYPtUATDU0ujEgpNNzFOqLde_ecD7RfBVUdvE0S_9pSfM2IlZAbqSwDNYuDZDZ9KiTCtF4WPk May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 7f90fe05c0fe4fc3ad01a3ce443559ca May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesGetTestJSON-384146982 May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:25:06.007622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f90fe05c0fe4fc3ad01a3ce443559ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7f90fe05c0fe4fc3ad01a3ce443559ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7f90fe05c0fe4fc3ad01a3ce443559ca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7f90fe05c0fe4fc3ad01a3ce443559ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesGetTestJSON-384146982 May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 7f90fe05c0fe4fc3ad01a3ce443559ca May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesGetTestJSON-384146982 May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesGetTestJSON-384146982-project May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 533bab67fb4b437ea559c96a80a84255 May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesGetTestJSON-384146982-project May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '49f31285-08fd-4b64-811e-079b98fc05b5'} May 31 18:25:06.009015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. (HTTP 404) (Request-ID: req-b33a7129-134c-4d70-8d33-6efc244ab85c) May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:06.009762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:06.010891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 18:25:06.011939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. May 31 18:25:06.013012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:06.016114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f27ba161-9403-4a9c-af9b-19a01a8fd7eb tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] Returning 404 to user: Volume 49f31285-08fd-4b64-811e-079b98fc05b5 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:25:06.016114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f27ba161-9403-4a9c-af9b-19a01a8fd7eb tempest-VolumesGetTestJSON-384146982 tempest-VolumesGetTestJSON-384146982-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5" status: 404 len: 109 microversion: 2.1 time: 0.059404 May 31 18:25:06.016114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 30/49] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:05 2022] GET /compute/v2.1/os-volumes/49f31285-08fd-4b64-811e-079b98fc05b5 => generated 109 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:25:06.027186 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e6f6c37b-a9e7-4bb1-be48-058da2960b6b tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74d0c310>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:06.155176 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e6f6c37b-a9e7-4bb1-be48-058da2960b6b tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 202 len: 0 microversion: 2.1 time: 0.137475 May 31 18:25:06.157331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 31/50] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:25:06 2022] DELETE /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:25:06.166693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-78bd5799-d681-4c79-83c1-2c92052d3b20 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb755a9a60>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:06.377480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-78bd5799-d681-4c79-83c1-2c92052d3b20 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 200 len: 345 microversion: 2.1 time: 0.215145 May 31 18:25:06.382346 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 32/51] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:06 2022] GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 345 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:06.891167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:06.892600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:06.918315 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:06.931119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:06.933663 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:06.939723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:08.547264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:08.587622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c96da4ef-6072-46f9-be80-ab3f762057c3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 1.700537 May 31 18:25:08.588550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 33/52] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:06 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:08.612730 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c64d98ac-9598-43ea-93d6-15fb54de64f2 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb74d0c790>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:08.794337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-c64d98ac-9598-43ea-93d6-15fb54de64f2 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] HTTP exception thrown: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c64d98ac-9598-43ea-93d6-15fb54de64f2 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Request method failure captured: May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d HTTP/1.1 May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1vYX1yOPjUBPldKd64_V9uY3H9iZXSdGTUdhobe1LGq5mGWCTmnno1d7nUuHfSLtI7kPouNbaIlDZ-XzizW2Pq1w8WlzcGsXwDiuIDj1-XEzAlptjWRqyaV-_pYDD482KyJWWkbW2P23czvaGTXh2SeaeGKEfhP-ykHxGJwKhlHVI May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:25:08.801578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 59b715d3b6024ee7b6ddbfebcbaf4c18 May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '43714ec4-0f01-497e-b968-c6a0345fb44d'} May 31 18:25:08.802883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. (HTTP 404) (Request-ID: req-7a477a54-48d7-4a93-b01d-e01c0e5c41f3) May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:08.804205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:08.805220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 18:25:08.806140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:08.807149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:25:08.814530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c64d98ac-9598-43ea-93d6-15fb54de64f2 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Returning 404 to user: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:25:08.815629 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c64d98ac-9598-43ea-93d6-15fb54de64f2 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 404 len: 109 microversion: 2.1 time: 0.206875 May 31 18:25:08.816799 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 34/53] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:08 2022] GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 109 bytes in 228 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:25:08.890026 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:25:08.890574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:25:08.891139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:25:08.891719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:25:08.892304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:25:08.927314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:08.927802 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:08.928858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:08.929105 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:08.991389 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:25:08.999518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:25:09.017515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:25:09.020291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:25:09.092947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-de59c8ca-793b-4dba-be75-d8a955ad0d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.195846 May 31 18:25:09.094546 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 20/54] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:25:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 4199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:25:09.100541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4197ba28-c27b-417b-a86c-c27523d83944 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb744fc160>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:09.429969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:09.582339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-4197ba28-c27b-417b-a86c-c27523d83944 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] HTTP exception thrown: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4197ba28-c27b-417b-a86c-c27523d83944 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Request method failure captured: May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d HTTP/1.1 May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill1vYX1yOPjUBPldKd64_V9uY3H9iZXSdGTUdhobe1LGq5mGWCTmnno1d7nUuHfSLtI7kPouNbaIlDZ-XzizW2Pq1w8WlzcGsXwDiuIDj1-XEzAlptjWRqyaV-_pYDD482KyJWWkbW2P23czvaGTXh2SeaeGKEfhP-ykHxGJwKhlHVI May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:25:09.590057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 59b715d3b6024ee7b6ddbfebcbaf4c18 May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '43714ec4-0f01-497e-b968-c6a0345fb44d'} May 31 18:25:09.591303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. (HTTP 404) (Request-ID: req-0c390a54-8ff2-40dd-a06f-650b5fce5187) May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:09.591993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 18:25:09.593007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 18:25:09.594017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4197ba28-c27b-417b-a86c-c27523d83944 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Returning 404 to user: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:25:09.595475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4197ba28-c27b-417b-a86c-c27523d83944 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 404 len: 109 microversion: 2.1 time: 0.495975 May 31 18:25:09.599754 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 21/55] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:25:09 2022] DELETE /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 109 bytes in 504 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:25:09.637552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1230249860", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2863d12-f128-4cc6-8ca8-950d8f1eec2e"}], "security_groups": [{"name": "tempest-securitygroup--2056999300"}], "key_name": "tempest-keypair-67692383", "user_data": "}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:10.036600 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] validate_networks() for [('f2863d12-f128-4cc6-8ca8-950d8f1eec2e', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:25:10.358321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1083232094", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:10.669559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] validate_networks() for [('cec29bb7-5f55-4916-bcd5-7dcf178908d4', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:25:11.896420 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:25:11.898912 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:25:11.900317 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:25:11.900903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:25:11.901673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:25:11.937553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:11.940284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:11.941963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:11.946568 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:12.011475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for project 7ea083067dfc4b6194457652a3501317. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:25:12.019136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for user 7c6d1ac15d024f77bb363170ab423c0b and project 7ea083067dfc4b6194457652a3501317. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:25:12.080991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:25:12.087388 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:25:12.269064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8ac1872a-2a9b-41bc-87e3-51b9c16b73bc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.667775 May 31 18:25:12.271044 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 22/56] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:25:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:25:12.277082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:12.278430 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:12.314047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:12.322035 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:12.324875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:12.325553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:12.755189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:12.770200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-35fd2022-11bf-4eea-9c84-53b8f1c714c3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1292 microversion: 2.1 time: 0.496401 May 31 18:25:12.773553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 23/57] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:12 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1292 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:12.780149 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:12.781053 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:12.806794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:12.808198 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:12.812399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:12.815521 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:13.719576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:25:13.720165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:25:13.720815 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:25:13.721342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:25:13.721982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:25:13.760399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:13.765104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:13.769678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:13.772356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-15304546-2f98-4550-9c22-7a2ae47f9395 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.996466 May 31 18:25:13.773284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 24/58] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:12 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:13.778859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d8f6ea3f-163c-45fb-95e2-e41949eaf754 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Calling method '.version_select at 0x7ffb745299d0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:13.780622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:13.783139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:13.836445 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-d8f6ea3f-163c-45fb-95e2-e41949eaf754 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] HTTP exception thrown: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d8f6ea3f-163c-45fb-95e2-e41949eaf754 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Request method failure captured: May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d HTTP/1.1 May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill1vYX1yOPjUBPldKd64_V9uY3H9iZXSdGTUdhobe1LGq5mGWCTmnno1d7nUuHfSLtI7kPouNbaIlDZ-XzizW2Pq1w8WlzcGsXwDiuIDj1-XEzAlptjWRqyaV-_pYDD482KyJWWkbW2P23czvaGTXh2SeaeGKEfhP-ykHxGJwKhlHVI May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:25:13.839005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/897cd0f4ba254c5e9135ca4f5f7747a4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 897cd0f4ba254c5e9135ca4f5f7747a4 May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2002974879 May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 59b715d3b6024ee7b6ddbfebcbaf4c18 May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2002974879-project May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '43714ec4-0f01-497e-b968-c6a0345fb44d'} May 31 18:25:13.840228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. (HTTP 404) (Request-ID: req-b24c5250-2fb3-4d52-b4dd-ca321d23c436) May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:13.840964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:25:13.842011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 18:25:13.843017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. May 31 18:25:13.844170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:25:13.845997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d8f6ea3f-163c-45fb-95e2-e41949eaf754 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] Returning 404 to user: Volume 43714ec4-0f01-497e-b968-c6a0345fb44d could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:25:13.847334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d8f6ea3f-163c-45fb-95e2-e41949eaf754 tempest-VolumesSnapshotsTestJSON-2002974879 tempest-VolumesSnapshotsTestJSON-2002974879-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d" status: 404 len: 109 microversion: 2.1 time: 0.072678 May 31 18:25:13.848074 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 25/59] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:25:13 2022] GET /compute/v2.1/os-volumes/43714ec4-0f01-497e-b968-c6a0345fb44d => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:25:13.889049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for project 2628eee87b7147b8866790922d57222c. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:25:13.903064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for user 39fdc2681def478990bb4b78de5d34ee and project 2628eee87b7147b8866790922d57222c. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:25:13.935879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:25:13.947134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:25:14.261734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-53c469f7-f8a0-4ffe-93e6-86d0de2ade3a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.443581 May 31 18:25:14.262384 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 35/60] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:25:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 5445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:25:14.271705 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:14.272365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:14.288645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:14.300868 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:14.307065 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:14.310287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:14.624502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:14.634697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e162f595-6556-44a0-861e-8ac377731ba5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1232 microversion: 2.1 time: 0.370942 May 31 18:25:14.641674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 36/61] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:14 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1232 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:14.653078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:14.657989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:14.673147 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:14.674108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:14.683579 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:14.685165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:15.093504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-6de343fd-2797-48ec-ba85-f8127f167ad4 req-6c2a5fa9-e840-44e2-a882-68084bd14744 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea8df5a9-e26d-4d19-afcc-e9816946f13b", "tag": "abfe619e-5ae9-4b80-ba9e-b7a76b137568"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:15.141757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-6de343fd-2797-48ec-ba85-f8127f167ad4 req-6c2a5fa9-e840-44e2-a882-68084bd14744 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:15.142524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-6de343fd-2797-48ec-ba85-f8127f167ad4 req-6c2a5fa9-e840-44e2-a882-68084bd14744 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:15.251423 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-6de343fd-2797-48ec-ba85-f8127f167ad4 req-6c2a5fa9-e840-44e2-a882-68084bd14744 service nova] Creating event network-changed:abfe619e-5ae9-4b80-ba9e-b7a76b137568 for instance ea8df5a9-e26d-4d19-afcc-e9816946f13b on hv-cinder-83979 May 31 18:25:15.253591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-6de343fd-2797-48ec-ba85-f8127f167ad4 req-6c2a5fa9-e840-44e2-a882-68084bd14744 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 18:25:15.257206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:15.267173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:15.272618 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:15.275520 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:15.348018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.compute.rpcapi [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 18:25:15.350007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] Releasing lock "compute-rpcapi-router" {{(pid=117589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 18:25:15.391543 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a7e5be51-4b4b-4f9c-b8eb-82a411e50c34 None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.542001 May 31 18:25:15.393738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 26/62] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:15.401153 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e70e4a1a-dd85-4e0c-a9db-725b4da3dee8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:15.405035 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e70e4a1a-dd85-4e0c-a9db-725b4da3dee8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:16.039207 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:16.054803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f5acb774-4576-4ad1-b405-e6005ed2ca47 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1298 microversion: 2.1 time: 1.411357 May 31 18:25:16.071842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 37/63] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:14 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1298 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:16.089646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:16.090317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:16.134785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:16.139350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:16.140631 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:16.141893 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:16.528968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e70e4a1a-dd85-4e0c-a9db-725b4da3dee8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:16.537013 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e70e4a1a-dd85-4e0c-a9db-725b4da3dee8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1222 microversion: 2.1 time: 1.141319 May 31 18:25:16.537886 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 27/64] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:15 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1222 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:16.547917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:16.548581 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:16.594275 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:16.598012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:16.599595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:16.608698 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:17.073380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:17.089197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1489e4c1-4985-4756-82f3-56bc11d07808 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1294 microversion: 2.1 time: 0.547806 May 31 18:25:17.090158 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 28/65] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:16 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1294 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:17.095576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1326419660", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:17.288619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] validate_networks() for [('cec29bb7-5f55-4916-bcd5-7dcf178908d4', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:25:17.605485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:17.613473 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3da3935c-a11b-4ae9-89b3-5dac15e682d4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 1.540309 May 31 18:25:17.623915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 38/66] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:16 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:17.629275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:17.630071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:17.644285 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:17.644901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:17.656625 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:17.657296 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:18.070959 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:18.074077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=61 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:18.101827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4377c974-0a72-4ef8-b691-80bfffdd7fd3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1298 microversion: 2.1 time: 0.470983 May 31 18:25:18.124306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 39/67] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:17 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1298 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:18.137268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:18.142550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:18.153621 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:18.176474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:18.179659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:18.183397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:18.184359 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:18.705955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:18.732475 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ffc0271e-321f-4ff6-940f-5cde7de76f57 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1294 microversion: 2.1 time: 0.613592 May 31 18:25:18.750685 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 40/68] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:18 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1294 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:18.777045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:18.778746 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:18.798348 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:18.799192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:18.800536 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:18.801759 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:19.872981 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:25:19.873501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:25:19.873887 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:25:19.874303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:25:19.874725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:25:19.879571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:19.898900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=27 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:19.902041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:19.902499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:19.910205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:19.910681 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:19.954306 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=41 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:19.991041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for project 2628eee87b7147b8866790922d57222c. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:25:20.002941 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for user 39fdc2681def478990bb4b78de5d34ee and project 2628eee87b7147b8866790922d57222c. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:25:20.029817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:25:20.033609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:25:20.135260 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9a8eed43-eb23-4825-ab0d-5a4af3977e4b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.043649 May 31 18:25:20.136427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 29/69] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:25:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 3046 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:25:20.143111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:20.144194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:20.154011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:20.154810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:20.156081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:20.156900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:20.357781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:20.375421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9325589e-f0ee-44ef-921d-64eab5436c11 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 1.611427 May 31 18:25:20.375421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 41/70] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:18 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:20.378472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:20.385493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:20.415088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:20.416696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:20.417955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:20.418932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:21.085812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:21.100926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-433511d8-d734-4b95-9bd3-0e72de4a27ee tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.963167 May 31 18:25:21.116042 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 30/71] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:20 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:21.129546 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-36be6f43-970e-4639-bdab-e3291d119a0f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:21.130263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-36be6f43-970e-4639-bdab-e3291d119a0f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:21.188445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:21.197570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8dae49e2-230d-4c18-b41e-5edfeb46c685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.829160 May 31 18:25:21.204434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 42/72] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:20 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:21.384947 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:21.386404 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:21.397443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:21.399155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:21.404189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-36be6f43-970e-4639-bdab-e3291d119a0f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:21.409399 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:21.414145 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-36be6f43-970e-4639-bdab-e3291d119a0f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1222 microversion: 2.1 time: 0.301495 May 31 18:25:21.416228 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:21.422597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 31/73] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:21 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1222 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:22.119981 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:22.121598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:22.145701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.151658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.163569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.165229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.399854 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:22.412668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cd6c45f3-7e19-43e7-8845-2a9b47fd999a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 1.032597 May 31 18:25:22.413239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 43/74] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:21 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:22.428213 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:22.428861 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:22.444303 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.444745 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.445539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.445970 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.731559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:22.744259 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4f61b5a8-95db-46d8-ad71-9d189aa3b901 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.628997 May 31 18:25:22.756821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 32/75] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:22 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:22.768350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:22.769248 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:22.787479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.792366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.793618 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.794824 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.818530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:22.833171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9841379c-dfa0-4e12-82b4-58e6203ad9af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.418698 May 31 18:25:22.838903 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 44/76] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:22 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:22.904270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-dc17c55d-7955-40b8-8025-8ae05773bd9d req-f1b638b0-8930-4446-b860-a3dcdd7a5508 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cc87a-c08b-48eb-9014-e1a997cd84d7", "tag": "c06d263b-c5ec-4362-8ed7-8fe070f4b8e9"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:22.932444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-dc17c55d-7955-40b8-8025-8ae05773bd9d req-f1b638b0-8930-4446-b860-a3dcdd7a5508 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.938277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-dc17c55d-7955-40b8-8025-8ae05773bd9d req-f1b638b0-8930-4446-b860-a3dcdd7a5508 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.957863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:22.992379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-dc17c55d-7955-40b8-8025-8ae05773bd9d req-f1b638b0-8930-4446-b860-a3dcdd7a5508 service nova] Creating event network-changed:c06d263b-c5ec-4362-8ed7-8fe070f4b8e9 for instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 on hv-cinder-83979 May 31 18:25:22.993144 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-dc17c55d-7955-40b8-8025-8ae05773bd9d req-f1b638b0-8930-4446-b860-a3dcdd7a5508 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 18:25:22.994549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:22.997120 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:22.998325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.000874 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.004639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8cb8e62f-8bc8-48e6-9188-92ff30da5044 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1274 microversion: 2.1 time: 0.245811 May 31 18:25:23.005947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 33/77] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:22 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:23.031535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.compute.rpcapi [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 18:25:23.033360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] Releasing lock "compute-rpcapi-router" {{(pid=117590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 18:25:23.063743 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7dd9a8a0-ea8f-4138-a7ea-9e44577dd97a None None] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161310 May 31 18:25:23.065092 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 45/78] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:25:23.429519 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:23.430257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:23.437487 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.437914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.438692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.439133 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.623466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:23.631758 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-24ce1a92-c10f-4f7e-b221-6faea319e173 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.206429 May 31 18:25:23.632661 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 34/79] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:23 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:23.761884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:23.762918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:23.771536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.771984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.772828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.773458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.868372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-d79daa18-bb63-40e3-b1ed-8fcaa6286695 req-bfcb603a-f5fd-44ac-aa0e-5b1931ceb1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb08f80-5f98-4bb9-a683-73f38dfaeb6d", "tag": "59b7005a-ed60-4f1b-a721-14607b66ea9f"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:23.904052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-d79daa18-bb63-40e3-b1ed-8fcaa6286695 req-bfcb603a-f5fd-44ac-aa0e-5b1931ceb1b4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.905360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-d79daa18-bb63-40e3-b1ed-8fcaa6286695 req-bfcb603a-f5fd-44ac-aa0e-5b1931ceb1b4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.925866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:23.937281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-d79daa18-bb63-40e3-b1ed-8fcaa6286695 req-bfcb603a-f5fd-44ac-aa0e-5b1931ceb1b4 service nova] Creating event network-changed:59b7005a-ed60-4f1b-a721-14607b66ea9f for instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d on hv-cinder-83979 May 31 18:25:23.943520 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-d79daa18-bb63-40e3-b1ed-8fcaa6286695 req-bfcb603a-f5fd-44ac-aa0e-5b1931ceb1b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370507 May 31 18:25:23.944992 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 46/80] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:25:23.956454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:23.957481 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:23.973203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.975356 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:23.976531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:23.977018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:24.035157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:24.049251 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0597764b-01cf-4e8a-9549-584f3af80e79 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.291432 May 31 18:25:24.050182 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 35/81] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:23 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:24.059650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:24.061987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:24.076017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:24.078909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:24.080130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:24.081965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:24.323624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:24.348560 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-461e8adc-3e80-43f7-8159-30d1461f7f0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1282 microversion: 2.1 time: 0.292440 May 31 18:25:24.350431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 36/82] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:24 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1282 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:24.463067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:24.473264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-207eb65c-7a44-4035-b1de-eed3ace5c8d9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.523261 May 31 18:25:24.474390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 47/83] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:23 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:24.651508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:24.652796 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:24.669585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:24.672412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:24.675965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:24.676863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:24.907298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:24.916157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9a8d1a99-7949-42bc-9806-6429fae95e62 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.270633 May 31 18:25:24.925129 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 37/84] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:24 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:25.074588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:25.075835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:25.085235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-aeab4830-d7c3-4665-bbc3-764434bb0277 req-acc6f0f8-4b5d-4da1-bda4-ea74f06dffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf24b7e-be1e-4235-a568-b5679595a5bd", "tag": "90e3439b-12bb-4408-80c9-2545132e076f"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:25.085846 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.086583 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.088560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.089584 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.101604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-aeab4830-d7c3-4665-bbc3-764434bb0277 req-acc6f0f8-4b5d-4da1-bda4-ea74f06dffb5 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.102349 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-aeab4830-d7c3-4665-bbc3-764434bb0277 req-acc6f0f8-4b5d-4da1-bda4-ea74f06dffb5 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.114819 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-aeab4830-d7c3-4665-bbc3-764434bb0277 req-acc6f0f8-4b5d-4da1-bda4-ea74f06dffb5 service nova] Creating event network-changed:90e3439b-12bb-4408-80c9-2545132e076f for instance abf24b7e-be1e-4235-a568-b5679595a5bd on hv-cinder-83979 May 31 18:25:25.120736 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-aeab4830-d7c3-4665-bbc3-764434bb0277 req-acc6f0f8-4b5d-4da1-bda4-ea74f06dffb5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042448 May 31 18:25:25.121910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 38/85] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:25.299832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:25.312356 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-914f83d9-1685-4a47-8e61-9a01f3cd7314 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.246471 May 31 18:25:25.314578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 48/86] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:25 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:25.378723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:25.379806 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:25.395474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.396036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.399394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.401447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.472022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:25.481624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-371ae12c-8478-49f2-ad75-dca5783106f4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1280 microversion: 2.1 time: 0.117625 May 31 18:25:25.483290 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 39/87] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:25 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1280 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:25.502056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:25.503332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:25.515834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.516663 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.518571 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.519027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.685118 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:25.694270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-052aee3d-b06c-4e9a-b078-088ed06a0435 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.206945 May 31 18:25:25.704056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 49/88] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:25 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:25.933803 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:25.934417 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:25.940479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.941288 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:25.942071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:25.942523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:26.125942 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:26.135803 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a7623cb1-9d95-45a6-ae64-1a56d9b4876a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.205730 May 31 18:25:26.146973 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 40/89] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:25 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:26.344595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:26.345788 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:26.353949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:26.354772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:26.355986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:26.356706 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:26.507466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:26.508379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:26.522951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:26.523624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:26.524682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:26.525270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:26.533225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:26.543805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2d9875b9-8d6a-4e85-a161-9dc198fd970d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.204304 May 31 18:25:26.554901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 50/90] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:26 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:26.627714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:26.638721 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-06c2aa77-cdec-4f46-94a5-3d3d672b8ac4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1280 microversion: 2.1 time: 0.141453 May 31 18:25:26.648977 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 41/91] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:26 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1280 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:26.723116 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:26.725076 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:26.741729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:26.745106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:26.747370 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:26.749414 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:27.154270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:27.155025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:27.173160 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:27.173943 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:27.174889 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:27.178632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:27.750044 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:27.761699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9c7bafd3-5a5b-467e-be2d-ec361ccdbeca tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 1.047032 May 31 18:25:27.762447 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 51/92] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:26 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:27.786542 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:27.793140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:27.808962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:27.813569 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:27.820583 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:27.821535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:27.871238 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:27.890675 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c03888c7-901c-4d67-ab9a-7fba224d2daa tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.741621 May 31 18:25:27.905740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 42/93] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:27 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:27.919265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:27.919810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:27.927442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:27.928202 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:27.929928 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:27.930592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:28.174953 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:28.193499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-827622c8-cf65-46fc-a4cf-b1132f979531 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1280 microversion: 2.1 time: 0.284765 May 31 18:25:28.196934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 43/94] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:27 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1280 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:28.442536 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:28.461306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1ec94bd9-73b5-47de-81e6-1ed766a11577 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.696689 May 31 18:25:28.462219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 52/95] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:27 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:28.790392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:28.791119 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:28.801782 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:28.805041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:28.807469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:28.808723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:28.922209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:28.923340 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:28.947275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:28.948192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:28.949881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:28.956849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:29.196108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:29.212415 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6e46fcae-26d7-41a7-bf2f-5813fd6dff9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.418851 May 31 18:25:29.221831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 44/96] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:28 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:29.221831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:29.221831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:29.231695 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:29.236288 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:29.237301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:29.237896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:29.539332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:29.548767 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0c447239-a017-443a-8051-bc7ab9fcfa24 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.639742 May 31 18:25:29.560290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 53/97] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:28 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:29.561099 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:29.561687 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:29.580147 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:29.583234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:29.585232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:29.585691 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:29.667217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:29.681278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-df77a1f2-6c6a-49d0-a30f-d70617e78039 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.466743 May 31 18:25:29.681861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 45/98] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:29 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:30.078607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:30.089190 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ed2f9e42-45d4-47e3-87ad-3c0ef64afb34 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.531758 May 31 18:25:30.090102 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 54/99] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:29 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:30.232820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:30.234096 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:30.237120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=8 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:30.251781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:30.252997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:30.253941 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:30.254394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:30.485356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:30.495276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f39f66a0-48b0-40ee-ba29-f3e959a4f1a7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.267534 May 31 18:25:30.496422 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 46/100] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:30 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:30.572023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:30.572805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:30.592056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:30.592540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:30.593339 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:30.593770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:30.698094 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:30.699115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:30.710806 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:30.711600 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:30.713186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:30.714616 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:31.007968 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:31.018085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7469de83-be8b-4ff6-a8cf-0fab7af69cf5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.454131 May 31 18:25:31.020585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 55/101] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:30 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:31.063784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:31.075024 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-80e6aca2-c063-48a5-b0bc-2bf621405361 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.380673 May 31 18:25:31.076599 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 47/102] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:30 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:31.109111 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:31.110723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:31.120134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:31.120936 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:31.122474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:31.123415 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:31.345747 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:31.355651 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c4451148-dca9-4e3f-8977-96a216981888 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.251254 May 31 18:25:31.356253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 56/103] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:31 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:31.491391 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=7 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:31.520282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:31.522457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:31.529245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:31.529871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:31.530791 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:31.531406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:31.560033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:31.753055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:31.771827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b64ccec3-086c-402e-92ca-4096a185a407 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.258703 May 31 18:25:31.786454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 57/104] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:31 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:32.008483 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-3c2b77e7-d1c2-4001-9b3b-f200f147a501 req-b0ae43ab-4cc0-4672-9a4c-bbe867d69e85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8df5a9-e26d-4d19-afcc-e9816946f13b", "name": "network-vif-plugged", "status": "completed", "tag": "abfe619e-5ae9-4b80-ba9e-b7a76b137568"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:32.025123 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-3c2b77e7-d1c2-4001-9b3b-f200f147a501 req-b0ae43ab-4cc0-4672-9a4c-bbe867d69e85 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.026392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-3c2b77e7-d1c2-4001-9b3b-f200f147a501 req-b0ae43ab-4cc0-4672-9a4c-bbe867d69e85 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.035555 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:32.037528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:32.038173 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:32.048021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.048509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.049297 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.049738 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.059355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-3c2b77e7-d1c2-4001-9b3b-f200f147a501 req-b0ae43ab-4cc0-4672-9a4c-bbe867d69e85 service nova] Creating event network-vif-plugged:abfe619e-5ae9-4b80-ba9e-b7a76b137568 for instance ea8df5a9-e26d-4d19-afcc-e9816946f13b on hv-cinder-83979 May 31 18:25:32.069541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-3c2b77e7-d1c2-4001-9b3b-f200f147a501 req-b0ae43ab-4cc0-4672-9a4c-bbe867d69e85 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.581045 May 31 18:25:32.070589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 48/105] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:32.100794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:32.102483 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:32.116334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.117446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.118863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.119866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.283890 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:32.303890 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-06a9aa69-bb43-4095-9deb-739dff5ec28a tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.270909 May 31 18:25:32.304755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 58/106] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:32 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:32.330260 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:32.339347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-eac836b3-aded-4f00-a178-563d9515ebfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.247868 May 31 18:25:32.354808 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 49/107] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:32 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:32.373204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:32.374300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:32.382060 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.382511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.383288 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.383727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.584517 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:32.601277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5f912ceb-e1cc-4c65-81aa-2e373fd57905 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.231789 May 31 18:25:32.601858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 59/108] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:32 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:32.793725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:32.795124 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:32.803950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.804433 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.805215 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:32.805649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:32.976323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:32.998627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e1f72f38-c293-470a-9914-31d0f6e195cb tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.210325 May 31 18:25:33.002270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 50/109] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:32 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:33.324657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:33.325943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:33.329216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:33.342160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:33.343666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:33.344948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:33.348699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:33.376793 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:33.378108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:33.403828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:33.404309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:33.405108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:33.405547 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:33.861425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:33.886942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-93c173e0-bc8d-427f-b0ec-9347ac663850 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.566530 May 31 18:25:33.890112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 60/110] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:33 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:33.909214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:33.910289 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:33.934331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:33.935126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:33.936610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:33.940326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:34.123792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:34.132600 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-03b3fadc-3236-4232-a1c1-7b4dabcbf14d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.775069 May 31 18:25:34.144363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 51/111] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:33 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:34.151232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:34.151758 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:34.179373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:34.179845 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:34.180691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:34.182661 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:34.383551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:34.408581 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e5d61b85-2874-45cc-ad94-dd29c87d9f70 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.514037 May 31 18:25:34.410266 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 61/112] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:33 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:34.493263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:34.506870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a35f7acf-e916-4327-81bf-32ba96258432 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.364589 May 31 18:25:34.507498 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 52/113] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:34 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:34.907913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:34.908621 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:34.918897 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:34.919619 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:34.921589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:34.923841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:34.961052 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-ab562df9-b96b-4c83-a604-7b3a03997385 req-e5bfdbe4-12b4-4bec-8fa3-7949fc7b1693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b68923-c8a5-4442-ad4d-4250c59297bd", "tag": "325d684d-e848-4a76-80a9-5caebe89e3ae"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:34.983922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-ab562df9-b96b-4c83-a604-7b3a03997385 req-e5bfdbe4-12b4-4bec-8fa3-7949fc7b1693 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:34.984997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-ab562df9-b96b-4c83-a604-7b3a03997385 req-e5bfdbe4-12b4-4bec-8fa3-7949fc7b1693 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.017181 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-ab562df9-b96b-4c83-a604-7b3a03997385 req-e5bfdbe4-12b4-4bec-8fa3-7949fc7b1693 service nova] Creating event network-changed:325d684d-e848-4a76-80a9-5caebe89e3ae for instance b4b68923-c8a5-4442-ad4d-4250c59297bd on hv-cinder-83979 May 31 18:25:35.064333 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-ab562df9-b96b-4c83-a604-7b3a03997385 req-e5bfdbe4-12b4-4bec-8fa3-7949fc7b1693 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105007 May 31 18:25:35.068443 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 53/114] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:25:35.157658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:35.159344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:35.174853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:35.175309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.176811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:35.177712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.210345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:35.219530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ce7ddf85-605c-406a-b933-a483d48551fe tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.316440 May 31 18:25:35.220407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 62/115] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:34 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:35.360710 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:35.369916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f8f19925-4891-43a7-b1a7-c717226476c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.218523 May 31 18:25:35.370878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 54/116] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:35 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:35.434777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:35.437020 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:35.448956 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:35.450170 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.451477 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:35.452315 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.534784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:35.536385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:35.543384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:35.544210 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.545239 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:35.546130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:35.810152 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:35.823092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e33dcd5a-872d-4792-b7f7-17ace777b3fe tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.291376 May 31 18:25:35.825417 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 55/117] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:35 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:35.855697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:35.870549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-08d1f68d-b9f5-4d37-81bf-c9d823dc9a56 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.439565 May 31 18:25:35.872066 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 63/118] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:35 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:36.045698 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-1f23d0ee-c222-46b6-b6a9-0dd03112f069 req-f3c2ac7c-6251-47d4-93eb-d37dce8a158b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf24b7e-be1e-4235-a568-b5679595a5bd", "name": "network-vif-plugged", "status": "completed", "tag": "90e3439b-12bb-4408-80c9-2545132e076f"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:36.076119 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1f23d0ee-c222-46b6-b6a9-0dd03112f069 req-f3c2ac7c-6251-47d4-93eb-d37dce8a158b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.079152 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1f23d0ee-c222-46b6-b6a9-0dd03112f069 req-f3c2ac7c-6251-47d4-93eb-d37dce8a158b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.113453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-1f23d0ee-c222-46b6-b6a9-0dd03112f069 req-f3c2ac7c-6251-47d4-93eb-d37dce8a158b service nova] Creating event network-vif-plugged:90e3439b-12bb-4408-80c9-2545132e076f for instance abf24b7e-be1e-4235-a568-b5679595a5bd on hv-cinder-83979 May 31 18:25:36.131187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-1f23d0ee-c222-46b6-b6a9-0dd03112f069 req-f3c2ac7c-6251-47d4-93eb-d37dce8a158b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090957 May 31 18:25:36.132695 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 56/119] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:36.244753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:36.245827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:36.253661 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.254497 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.255567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.256574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.390718 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:36.392543 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:36.406858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.408285 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.409304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.409960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.749807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:36.764869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a8c33e23-cabd-4a9a-b929-e5580d0231b1 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.531628 May 31 18:25:36.765654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 64/120] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:36 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:36.829409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:36.840522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f22fb3aa-9421-43a5-a57e-b5ce4af2d8de tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.456523 May 31 18:25:36.845205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 57/121] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:36 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:36.853054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:36.853715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:36.860071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.860586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.861444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.861889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.890126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:36.891541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:36.898334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.899013 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:36.899833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:36.900337 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:37.210222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:37.219964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5896b91c-39b7-45fa-9535-803c565e6ca1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.377297 May 31 18:25:37.237482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:37.243065 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 65/122] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:36 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:37.252475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0d869636-ee34-42e2-a845-3d55dafa57e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.366048 May 31 18:25:37.253221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 58/123] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:36 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:37.788078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:37.790053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:37.824392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:37.825265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:37.826581 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:37.827485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:37.867615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:37.869005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:37.883307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:37.883771 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:37.887729 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:37.888230 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:38.182553 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:38.196653 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-81a73856-8c04-42d4-8b55-92116a4673de tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1313 microversion: 2.1 time: 0.415854 May 31 18:25:38.201050 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 66/124] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:37 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1313 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:38.211320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-65f99544-f66f-49de-9618-aa1fcc97749b req-566a3bd3-1309-4a4d-8815-a2355b7e9902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9cc87a-c08b-48eb-9014-e1a997cd84d7", "name": "network-vif-plugged", "status": "completed", "tag": "c06d263b-c5ec-4362-8ed7-8fe070f4b8e9"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:38.224628 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:38.227791 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-65f99544-f66f-49de-9618-aa1fcc97749b req-566a3bd3-1309-4a4d-8815-a2355b7e9902 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:38.232212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-986fe511-90e0-48ac-a3cf-6e3ab41396a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.368901 May 31 18:25:38.234021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-65f99544-f66f-49de-9618-aa1fcc97749b req-566a3bd3-1309-4a4d-8815-a2355b7e9902 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:38.234154 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 59/125] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:37 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:38.247723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-65f99544-f66f-49de-9618-aa1fcc97749b req-566a3bd3-1309-4a4d-8815-a2355b7e9902 service nova] Creating event network-vif-plugged:c06d263b-c5ec-4362-8ed7-8fe070f4b8e9 for instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 on hv-cinder-83979 May 31 18:25:38.252631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:38.253779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:38.253917 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-65f99544-f66f-49de-9618-aa1fcc97749b req-566a3bd3-1309-4a4d-8815-a2355b7e9902 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050935 May 31 18:25:38.255274 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 67/126] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:38.272382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:38.272857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:38.273971 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:38.275278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:38.277465 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:38.278529 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:38.287310 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:38.288061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:38.288975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:38.289490 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:38.489834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:38.507190 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7e8641ab-66c1-4e2b-b14a-7a1d4466b9fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.233150 May 31 18:25:38.520556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 68/127] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:38 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:38.623516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:38.634129 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a01e15c3-f35b-4a62-8241-3e1947327e41 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.388407 May 31 18:25:38.653799 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 60/128] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:38 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:39.214184 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:39.214866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:39.221439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.221955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.222928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.223913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.253372 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:39.254054 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:39.261934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.262369 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.263561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.264213 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.458592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:39.466799 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:39.467381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-14ee804c-617e-4589-a1d1-d68ca93a3a13 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1499 microversion: 2.1 time: 0.257061 May 31 18:25:39.468333 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 69/129] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:39 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1499 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:39.477509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1ae95b14-8d2b-4ffb-a9b2-ca29752a3227 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.228904 May 31 18:25:39.478363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 61/130] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:39 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:39.528291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:39.529557 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:39.538160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.538612 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.539750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.540535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.652806 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:39.653743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:39.669286 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.669779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:39.670646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:39.671570 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:40.101779 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:40.112141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-03ba1b16-40b4-4831-8f9c-da82424f0eae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.588781 May 31 18:25:40.121972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 70/131] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:39 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:40.235474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:40.274045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1ec80ce4-354a-41c5-8c35-fc75b5a6172b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.616195 May 31 18:25:40.281055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 62/132] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:39 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:40.281261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-853ccc1c-0acf-4e94-ab79-cee6a8317fdf req-15466232-c26a-49ea-abf0-36671475caa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb08f80-5f98-4bb9-a683-73f38dfaeb6d", "name": "network-vif-plugged", "status": "completed", "tag": "59b7005a-ed60-4f1b-a721-14607b66ea9f"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:40.300730 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-853ccc1c-0acf-4e94-ab79-cee6a8317fdf req-15466232-c26a-49ea-abf0-36671475caa2 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:40.301225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-853ccc1c-0acf-4e94-ab79-cee6a8317fdf req-15466232-c26a-49ea-abf0-36671475caa2 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:40.338704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-853ccc1c-0acf-4e94-ab79-cee6a8317fdf req-15466232-c26a-49ea-abf0-36671475caa2 service nova] Creating event network-vif-plugged:59b7005a-ed60-4f1b-a721-14607b66ea9f for instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d on hv-cinder-83979 May 31 18:25:40.346678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-853ccc1c-0acf-4e94-ab79-cee6a8317fdf req-15466232-c26a-49ea-abf0-36671475caa2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072395 May 31 18:25:40.350794 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 71/133] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:40.497240 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:40.497666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:40.513624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:40.514303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:40.518231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:40.518884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:40.789853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:40.799844 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-315e2668-0dd2-4efe-a016-f9efc1316d4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.307593 May 31 18:25:40.800893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 63/134] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:40 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:40.975052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2492474c-b5b9-426a-bf11-b35e7403fdc0"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:40.976429 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:40.983152 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:40.983668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:40.984514 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:40.984952 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:41.133446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:41.133961 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:41.144117 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:41.144584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:41.146180 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:41.146707 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:41.350209 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:41.358058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-04393362-ed78-4f51-a39b-7e10affb36c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.231278 May 31 18:25:41.358615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 64/135] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:41 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:41.363311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:41.364970 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:41.371189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:41.371634 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:41.372440 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:41.372870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:41.515206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:41.523404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c1c309da-df88-491c-8f73-17f3627a029a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.163598 May 31 18:25:41.524162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 65/136] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:41 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:41.827813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:41.829002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:41.842189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:41.843091 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:41.844781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:41.845578 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:42.109602 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:42.112383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:42.123753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-74058e27-ad1e-4c8a-ae9c-15b42638bac9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.307850 May 31 18:25:42.127926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 66/137] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:41 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:42.377035 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:42.378558 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:42.386900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:42.387527 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:42.388528 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:42.389249 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:42.618513 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:42.632917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ad1913ec-5c22-4fb5-8331-b69b86d4181b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.259936 May 31 18:25:42.648126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 67/138] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:42 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:42.648126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:42.648126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:42.648126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:42.649403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:42.649403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:42.649403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:42.815649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:42.825021 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c6ef5bfc-64bd-4870-9262-84683b5e1b34 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.190104 May 31 18:25:42.835832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 68/139] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:42 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:43.145931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:43.146556 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:43.152796 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:43.153240 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:43.154017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:43.154444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:43.326410 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:43.339377 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-201a0c88-02f0-4164-b927-da263b05084d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.197357 May 31 18:25:43.340445 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 69/140] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:43 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:43.660369 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:43.661575 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:43.670593 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:43.671203 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:43.671988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:43.672442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:43.913565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:43.922190 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6649b3c3-b69c-488b-9183-d6cff1dc70d6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.267012 May 31 18:25:43.923134 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 70/141] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:43 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:43.928848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:43.929673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:43.935995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:43.936484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:43.937264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:43.938103 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:44.121702 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:44.143720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8fe2a623-f7eb-4e8d-959c-03870723b1ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1362 microversion: 2.1 time: 0.219386 May 31 18:25:44.144615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 71/142] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:43 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1362 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:44.357837 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:44.358075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:44.359995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:44.371772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:44.374241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:44.375298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:44.381896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:44.626607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:44.646687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e3865f82-6133-46e5-aea6-dc47c468e7c0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.292474 May 31 18:25:44.647619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 72/143] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:44 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:44.940666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:44.941371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:44.949394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:44.950191 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:44.950986 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:44.951430 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.139592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3e9e4297-9eaf-4585-a5e4-5a0cff34103b tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "POST /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.170430 May 31 18:25:45.145151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 72/144] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:25:40 2022] POST /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b/os-volume_attachments => generated 194 bytes in 4177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:45.160412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:45.170222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f09623b9-e611-49c6-8ae1-ef9e92651a6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1365 microversion: 2.1 time: 0.234060 May 31 18:25:45.170941 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 73/145] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:44 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1365 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:45.178373 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:45.179304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:45.193175 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:45.194551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.195795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:45.196428 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.469360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:45.478117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6777e6e5-333e-4313-b8fd-b5851c66ae96 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1548 microversion: 2.1 time: 0.309085 May 31 18:25:45.479219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 73/146] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:45 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1548 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:45.510427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:45.511862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:45.537597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:45.540839 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.544442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:45.546720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.666559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:45.667189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:45.683352 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:45.683816 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.684636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:45.685074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:45.702088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:45.768922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-10dca86c-73c2-4615-9a9b-5f4aa080f80f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.270685 May 31 18:25:45.770471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 74/147] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:25:45 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-interface => generated 284 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:46.188486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:46.189848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:46.215017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:46.220827 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:46.222427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:46.223514 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:46.463568 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:46.507734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5a3bedc4-a795-4e18-bb6b-102d59f1fb78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.844446 May 31 18:25:46.518778 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 74/148] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:45 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:46.731924 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:46.742516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4b4a3f80-21e7-4c38-adf0-6dd29805fd8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1554 microversion: 2.1 time: 0.557909 May 31 18:25:46.743103 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 75/149] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:46 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1554 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:46.768684 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:46.770013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:46.780819 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:46.781675 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:46.783745 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:46.784457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:46.962282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-56662516-7142-4c5e-bc7f-464f559157be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202326 May 31 18:25:46.963199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 75/150] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:25:46 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-interface => generated 284 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:47.531940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:47.533005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:47.562964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:47.563697 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:47.565004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:47.567788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:48.041540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:48.054622 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f4a3f254-b9dd-403d-b417-8644b693801a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.529949 May 31 18:25:48.064287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 76/151] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:47 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:48.860981 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-d6e26f5c-67f7-40d5-a562-4aa7ad6f44d9 req-3201350c-6742-4972-9fdf-eff033844e56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b68923-c8a5-4442-ad4d-4250c59297bd", "name": "network-vif-plugged", "status": "completed", "tag": "325d684d-e848-4a76-80a9-5caebe89e3ae"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:48.865716 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=72 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:48.876550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-d6e26f5c-67f7-40d5-a562-4aa7ad6f44d9 req-3201350c-6742-4972-9fdf-eff033844e56 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:48.885884 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-d6e26f5c-67f7-40d5-a562-4aa7ad6f44d9 req-3201350c-6742-4972-9fdf-eff033844e56 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:48.909576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-d6e26f5c-67f7-40d5-a562-4aa7ad6f44d9 req-3201350c-6742-4972-9fdf-eff033844e56 service nova] Creating event network-vif-plugged:325d684d-e848-4a76-80a9-5caebe89e3ae for instance b4b68923-c8a5-4442-ad4d-4250c59297bd on hv-cinder-83979 May 31 18:25:48.921976 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-d6e26f5c-67f7-40d5-a562-4aa7ad6f44d9 req-3201350c-6742-4972-9fdf-eff033844e56 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065505 May 31 18:25:48.924255 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 76/152] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:49.076382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:49.078509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:49.092015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:49.092648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:49.093804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:49.094476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:49.118229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-a2c8e572-a855-41c3-ad76-239ddc62a5ff req-1be09892-67a2-425e-a49b-1ae7ce3750ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad9cc87a-c08b-48eb-9014-e1a997cd84d7", "tag": "c06d263b-c5ec-4362-8ed7-8fe070f4b8e9"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:49.136221 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a2c8e572-a855-41c3-ad76-239ddc62a5ff req-1be09892-67a2-425e-a49b-1ae7ce3750ec service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:49.137317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a2c8e572-a855-41c3-ad76-239ddc62a5ff req-1be09892-67a2-425e-a49b-1ae7ce3750ec service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:49.162999 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-a2c8e572-a855-41c3-ad76-239ddc62a5ff req-1be09892-67a2-425e-a49b-1ae7ce3750ec service nova] Creating event network-changed:c06d263b-c5ec-4362-8ed7-8fe070f4b8e9 for instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 on hv-cinder-83979 May 31 18:25:49.170196 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-a2c8e572-a855-41c3-ad76-239ddc62a5ff req-1be09892-67a2-425e-a49b-1ae7ce3750ec service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056880 May 31 18:25:49.178478 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 77/153] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:25:49.928636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:49.938236 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-82deb5ea-8d46-41da-a13e-fdc21482cbfc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.869837 May 31 18:25:49.952915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 77/154] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:49 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:50.958229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:50.959756 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:50.977052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:50.977515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:50.978322 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:50.978777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:51.018363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:51.021605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:51.038653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:51.039666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:51.041433 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:51.042990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:51.107046 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:25:51.367941 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:51.376617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7fdb2f27-0b91-494a-bef3-f48bf72f851c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.423574 May 31 18:25:51.377192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 78/155] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:50 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:51.391632 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-9c4a6a17-1abc-4111-aee6-ef700ed45673 req-4bdcda3a-3e15-41de-be3b-38b1ddc0145f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdb08f80-5f98-4bb9-a683-73f38dfaeb6d", "tag": "59b7005a-ed60-4f1b-a721-14607b66ea9f"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:51.395321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-26347a0d-0fa0-4388-bf99-9b02e52fd8c4 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 204 len: 0 microversion: 2.1 time: 0.384079 May 31 18:25:51.402149 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 78/156] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:25:51 2022] DELETE /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:25:51.408523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:51.409867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:51.417909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:51.418998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:51.421127 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:51.421870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:51.428872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9c4a6a17-1abc-4111-aee6-ef700ed45673 req-4bdcda3a-3e15-41de-be3b-38b1ddc0145f service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:51.431909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9c4a6a17-1abc-4111-aee6-ef700ed45673 req-4bdcda3a-3e15-41de-be3b-38b1ddc0145f service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:51.477243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-9c4a6a17-1abc-4111-aee6-ef700ed45673 req-4bdcda3a-3e15-41de-be3b-38b1ddc0145f service nova] Creating event network-changed:59b7005a-ed60-4f1b-a721-14607b66ea9f for instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d on hv-cinder-83979 May 31 18:25:51.496515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-9c4a6a17-1abc-4111-aee6-ef700ed45673 req-4bdcda3a-3e15-41de-be3b-38b1ddc0145f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107643 May 31 18:25:51.497189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 79/157] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:51.799522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:51.834583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-84351fdd-10f8-42a7-847e-2e949ec7cbf3 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1551 microversion: 2.1 time: 0.429762 May 31 18:25:51.837064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 79/158] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:51 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1551 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:52.400160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:52.402537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:52.409913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:52.410674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:52.411675 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:52.413197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:52.718983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:52.729264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-73aea98f-239f-4d1c-b247-3c5c54a97eff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.333996 May 31 18:25:52.730750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 80/159] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:52 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:52.851915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:52.853789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:52.863783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:52.871163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:52.872380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:52.873016 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:53.163988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:53.173123 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9fc03dbf-d54e-43b1-8cfd-8f861035b949 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1551 microversion: 2.1 time: 0.325589 May 31 18:25:53.174143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 80/160] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:52 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1551 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:53.750321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:53.751726 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:53.760320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:53.761067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:53.762103 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:53.762606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:53.923796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:53.932732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e8e64c2b-14b6-4b80-9c1d-8b094adfc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1322 microversion: 2.1 time: 0.189727 May 31 18:25:53.943255 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 81/161] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:53 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:54.193729 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:54.194986 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:54.214093 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:54.216463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:54.225413 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:54.227280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:54.570263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:54.582338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-50f1b7a1-d6b5-41d9-97e7-e7470bafc8d5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1551 microversion: 2.1 time: 0.392724 May 31 18:25:54.592951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 81/162] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:54 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1551 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:54.952372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:54.953916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:54.965636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:54.965636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:54.965636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:54.966278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:55.273048 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:55.284397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-be9e413a-d297-4a5d-815f-228b2e53369e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1515 microversion: 2.1 time: 0.336838 May 31 18:25:55.285131 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 82/163] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:54 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1515 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:55.303413 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:55.306629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:55.333546 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:55.335840 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:55.338296 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:55.339189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:55.342313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:25:55.383792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lazy-loading 'flavor' on Instance uuid b4b68923-c8a5-4442-ad4d-4250c59297bd {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:25:55.527639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-655250cd-9c4f-4c3c-8dd8-b3d9791e601b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd/action" status: 200 len: 32 microversion: 2.1 time: 0.228728 May 31 18:25:55.528710 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 82/164] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:25:55 2022] POST /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd/action => generated 32 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:25:55.541825 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:55.544123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:55.561347 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:55.564072 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:55.568327 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:55.570072 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:55.601050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:55.601877 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:55.621315 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:55.621930 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:55.624465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:55.627268 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:56.459477 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:56.462021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:56.470080 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bda538c5-b069-4c36-af1e-41977fcb8e75 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.936065 May 31 18:25:56.472840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 83/165] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:55 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:56.477501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-da3a4437-5e6c-4f64-8e95-15cd90f47503 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1551 microversion: 2.1 time: 0.881181 May 31 18:25:56.484659 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 83/166] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:55 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1551 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:57.490492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:57.491470 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:57.502670 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:57.503122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:57.505355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:57.506773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:57.508120 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:57.508641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:57.519844 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:57.519844 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:57.519844 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:57.520067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:58.058904 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:58.063886 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:58.074562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aa9dec55-87dd-4321-83a6-fe126bf3f723 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1551 microversion: 2.1 time: 0.574774 May 31 18:25:58.075822 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 84/167] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:57 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1551 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:25:58.081863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-5d6ca06a-5f04-437e-a654-c73b2a7c7bb1 req-cc0b6c36-344f-4738-a398-54710d7beca4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea8df5a9-e26d-4d19-afcc-e9816946f13b", "name": "network-vif-deleted", "tag": "abfe619e-5ae9-4b80-ba9e-b7a76b137568"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:25:58.096532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-5d6ca06a-5f04-437e-a654-c73b2a7c7bb1 req-cc0b6c36-344f-4738-a398-54710d7beca4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:58.097905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-5d6ca06a-5f04-437e-a654-c73b2a7c7bb1 req-cc0b6c36-344f-4738-a398-54710d7beca4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:58.101343 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-62d42065-e470-4ce4-9699-57e0b921eff2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.616091 May 31 18:25:58.105018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 84/168] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:57 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:58.116959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-5d6ca06a-5f04-437e-a654-c73b2a7c7bb1 req-cc0b6c36-344f-4738-a398-54710d7beca4 service nova] Creating event network-vif-deleted:abfe619e-5ae9-4b80-ba9e-b7a76b137568 for instance ea8df5a9-e26d-4d19-afcc-e9816946f13b on hv-cinder-83979 May 31 18:25:58.122287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-5d6ca06a-5f04-437e-a654-c73b2a7c7bb1 req-cc0b6c36-344f-4738-a398-54710d7beca4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044603 May 31 18:25:58.123171 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 85/169] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:25:59.096033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:59.097768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:59.115146 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:59.115781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:59.120365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:59.121355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:59.122274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:25:59.123016 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:25:59.138926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:59.139770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:59.141033 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:59.149147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:59.211560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:25:59.212829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:25:59.213967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lazy-loading 'fault' on Instance uuid ea8df5a9-e26d-4d19-afcc-e9816946f13b {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:25:59.389503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abd536e419a544d895f054c7f6922171', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51bae70cfe74d2da95b93260c39ffc1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:59.399104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f0e6dc6d-de29-4065-9f98-e13ac07e7653 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 200 len: 1303 microversion: 2.1 time: 0.308465 May 31 18:25:59.400165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 85/170] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:59 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 1303 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:25:59.469108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:25:59.488685 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d1d9ae89-f65f-4e6f-94bd-82090c26f8d1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.368493 May 31 18:25:59.489797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 86/171] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:25:59 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:00.420411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:00.421922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:00.434353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:00.434869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:00.435690 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:00.436325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:00.467673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] HTTP exception thrown: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Request method failure captured: May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b HTTP/1.1 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1wR5KStrCB5SyBQza6vXz5UeZxcKsHRNq3p8Qfut5ps4Ql5ePO6CvBcnWWy3t0CRB1MckVu8ppzTmtsl8Z6PR5v9UWQJifDc7RVUrGnbgxgzN92QhPiEnJ4Wh8ZnAvJxWedV7eRqyDPALpDYDHP3dyVbe0Wmev6kCWP2UtwBD-Yw4 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:26:00.472974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: abd536e419a544d895f054c7f6922171 May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.474409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'ea8df5a9-e26d-4d19-afcc-e9816946f13b'} May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:26:00.475058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.476240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.478276 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Returning 404 to user: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:26:00.478276 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1ee9aea4-77e5-43c5-a80c-4df3a079a355 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 404 len: 111 microversion: 2.1 time: 0.061097 May 31 18:26:00.488772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 86/172] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:00 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:26:00.506628 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:00.507335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:00.515073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:00.515534 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:00.516365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:00.516954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:00.628434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:00.629402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:00.639282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:00.639740 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:00.640563 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:00.641003 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:00.655901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] HTTP exception thrown: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Request method failure captured: May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b/os-volume_attachments HTTP/1.1 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1wR5KStrCB5SyBQza6vXz5UeZxcKsHRNq3p8Qfut5ps4Ql5ePO6CvBcnWWy3t0CRB1MckVu8ppzTmtsl8Z6PR5v9UWQJifDc7RVUrGnbgxgzN92QhPiEnJ4Wh8ZnAvJxWedV7eRqyDPALpDYDHP3dyVbe0Wmev6kCWP2UtwBD-Yw4 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:26:00.664864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: abd536e419a544d895f054c7f6922171 May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.666114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'server_id': 'ea8df5a9-e26d-4d19-afcc-e9816946f13b'} May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:26:00.666773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:00.667831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:00.669235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Returning 404 to user: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:26:00.670166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8e80068d-366e-4f24-9aca-fb16ca7917da tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.045846 May 31 18:26:00.670977 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 87/173] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:26:00 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:26:00.762931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:00.782968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6b40a378-5925-4ac6-80d2-579155ed7f95 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.280363 May 31 18:26:00.783555 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 87/174] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:00 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:01.080969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1352456830", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "networks": [{"uuid": "48a96cbd-25b4-4538-9358-140c1ffcd2f8"}]}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:01.167355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] validate_networks() for [('48a96cbd-25b4-4538-9358-140c1ffcd2f8', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:26:01.801599 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:01.802222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:01.808862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:01.809581 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:01.810406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:01.811101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:01.959678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:26:01.960733 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:26:01.961298 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:26:01.961894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:26:01.962323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:26:01.972242 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:01.973216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:01.974132 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:01.974624 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:01.996671 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Getting quotas for project 7ea31516b7864535b1469752615237f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:26:02.001118 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Getting quotas for user 679646d952c94748af853799d5d39cc9 and project 7ea31516b7864535b1469752615237f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:26:02.036070 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:26:02.039626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:26:02.120661 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c162c83b-46ec-4e9d-a88d-aafb73f09f2a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.045360 May 31 18:26:02.123545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:02.129502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 88/175] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:26:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:26:02.137938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:02.138478 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:02.143638 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-03ddef26-3b80-4daf-b9d5-abfa181a2fdd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.346389 May 31 18:26:02.149995 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:02.150626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:02.151433 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:02.151544 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 88/176] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:01 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:02.151938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:02.160118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0f963ab6-16e5-477f-9f9d-94c93b0c9272 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:02.160874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0f963ab6-16e5-477f-9f9d-94c93b0c9272 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:02.178148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] HTTP exception thrown: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Request method failure captured: May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: DELETE /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b HTTP/1.1 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1wR5KStrCB5SyBQza6vXz5UeZxcKsHRNq3p8Qfut5ps4Ql5ePO6CvBcnWWy3t0CRB1MckVu8ppzTmtsl8Z6PR5v9UWQJifDc7RVUrGnbgxgzN92QhPiEnJ4Wh8ZnAvJxWedV7eRqyDPALpDYDHP3dyVbe0Wmev6kCWP2UtwBD-Yw4 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:26:02.179989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: abd536e419a544d895f054c7f6922171 May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.181166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'ea8df5a9-e26d-4d19-afcc-e9816946f13b'} May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:26:02.181807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.182837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.184243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Returning 404 to user: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:26:02.184243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-42ed6c75-41c2-4aa8-b767-d9bf52dcd852 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 404 len: 111 microversion: 2.1 time: 0.056191 May 31 18:26:02.184243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 89/177] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:26:02 2022] DELETE /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:26:02.195516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:02.196390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] [instance: ea8df5a9-e26d-4d19-afcc-e9816946f13b] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:02.204134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:02.204796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:02.206603 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:02.207368 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:02.227062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] HTTP exception thrown: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Request method failure captured: May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b HTTP/1.1 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill1wR5KStrCB5SyBQza6vXz5UeZxcKsHRNq3p8Qfut5ps4Ql5ePO6CvBcnWWy3t0CRB1MckVu8ppzTmtsl8Z6PR5v9UWQJifDc7RVUrGnbgxgzN92QhPiEnJ4Wh8ZnAvJxWedV7eRqyDPALpDYDHP3dyVbe0Wmev6kCWP2UtwBD-Yw4 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:26:02.229538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d51bae70cfe74d2da95b93260c39ffc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: d51bae70cfe74d2da95b93260c39ffc1 May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1683712753 May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: abd536e419a544d895f054c7f6922171 May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-DeleteServersTestJSON-1683712753-project May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.230943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'ea8df5a9-e26d-4d19-afcc-e9816946f13b'} May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:26:02.231659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. May 31 18:26:02.232729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:26:02.235558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] Returning 404 to user: Instance ea8df5a9-e26d-4d19-afcc-e9816946f13b could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:26:02.236664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-be1486f9-a792-43e4-9288-89d290b253a5 tempest-DeleteServersTestJSON-1683712753 tempest-DeleteServersTestJSON-1683712753-project] 10.222.0.17 "GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b" status: 404 len: 111 microversion: 2.1 time: 0.048489 May 31 18:26:02.245556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 90/178] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:02 2022] GET /compute/v2.1/servers/ea8df5a9-e26d-4d19-afcc-e9816946f13b => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:26:02.293420 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0f963ab6-16e5-477f-9f9d-94c93b0c9272 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:02.315345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0f963ab6-16e5-477f-9f9d-94c93b0c9272 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1214 microversion: 2.1 time: 0.160855 May 31 18:26:02.316718 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 89/179] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:02 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:03.166966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:03.168382 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:03.179516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:03.185199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:03.186112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:03.186820 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:03.334597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:03.335217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:03.350749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:03.355658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:03.356613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:03.357060 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:03.491510 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:03.502192 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-669062fd-a139-4c0b-a17f-3c6f9d00adf3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1266 microversion: 2.1 time: 0.171660 May 31 18:26:03.503119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:03.516338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 90/180] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:03 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:03.521302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-53dee848-3eb4-4c69-9401-1d03e16173e1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.356245 May 31 18:26:03.523092 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 91/181] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:03 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:04.523164 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:04.523890 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:04.530426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:04.530747 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:04.534296 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:04.547030 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:04.553277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:04.557386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:04.574868 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:04.575416 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:04.576476 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:04.578582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:04.955319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:04.964629 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ce3c1bcf-1589-450e-945f-d5712d4701e2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.427114 May 31 18:26:04.965208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 92/182] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:04 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:05.048482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:05.056186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a5589c31-7ab4-4369-989d-f4abada1e7c3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.536829 May 31 18:26:05.056763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 91/183] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:04 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:05.731167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1675418666", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "networks": [{"uuid": "77ec8a5b-182f-4f0c-96ec-b9e1b64385e5"}]}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:05.808328 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] validate_networks() for [('77ec8a5b-182f-4f0c-96ec-b9e1b64385e5', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:26:05.982222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:05.983065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:05.989229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:05.989877 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:05.990839 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:05.991434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:06.396014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:06.418090 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6c8a5fbf-97d2-4f7b-b205-42b711d52e93 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.439652 May 31 18:26:06.428629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 92/184] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:05 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:06.451556 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:06.454288 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:06.468874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:06.469626 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:06.470470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:06.470926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:06.698125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:26:06.698667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:26:06.700171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:26:06.700792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:26:06.701292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:26:06.717662 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:06.718194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:06.720470 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:06.721271 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:06.750467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Getting quotas for project d08b32a2616b44f9b4cdcb0bdb898044. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:26:06.761081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Getting quotas for user efaf39eaa1f24350b03960716b5d837e and project d08b32a2616b44f9b4cdcb0bdb898044. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:26:06.771214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:06.787521 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-62ae8b30-5ff1-456e-aa5b-2f302d5f3fdc tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.356461 May 31 18:26:06.788383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 93/185] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:06 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:06.793975 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-f7504539-3433-4a9e-88a2-0e5234226459 req-1c28eba4-48e7-4e82-b3a0-816200926ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cce4716-e4ed-4951-93cc-659e5bc96a0a", "tag": "fd7a8955-5a11-452e-a3ac-edc9f5503349"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:06.809653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-f7504539-3433-4a9e-88a2-0e5234226459 req-1c28eba4-48e7-4e82-b3a0-816200926ae9 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:06.809748 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:26:06.809843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-f7504539-3433-4a9e-88a2-0e5234226459 req-1c28eba4-48e7-4e82-b3a0-816200926ae9 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:06.810107 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:26:06.822617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-f7504539-3433-4a9e-88a2-0e5234226459 req-1c28eba4-48e7-4e82-b3a0-816200926ae9 service nova] Creating event network-changed:fd7a8955-5a11-452e-a3ac-edc9f5503349 for instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a on hv-cinder-83979 May 31 18:26:06.837313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-f7504539-3433-4a9e-88a2-0e5234226459 req-1c28eba4-48e7-4e82-b3a0-816200926ae9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047523 May 31 18:26:06.838386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 94/186] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:26:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:26:06.901329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b9d19adb-eb29-4afc-90ef-f83185ca0a55 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.174790 May 31 18:26:06.902268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 93/187] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:26:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:26:06.918393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ae56d331-0aa2-4a06-8f6f-5f3b568d1f0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:06.918393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ae56d331-0aa2-4a06-8f6f-5f3b568d1f0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:06.989171 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ae56d331-0aa2-4a06-8f6f-5f3b568d1f0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:07.001351 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ae56d331-0aa2-4a06-8f6f-5f3b568d1f0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1219 microversion: 2.1 time: 0.092515 May 31 18:26:07.001930 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 95/188] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:06 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:07.447124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:07.447645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:07.454423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:07.454866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:07.455627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:07.456059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:07.590460 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:07.599582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-47799edb-71fc-4b20-aed5-01a0893c06e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.155851 May 31 18:26:07.602839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 94/189] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:07 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:07.804874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:07.805606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:07.812280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:07.812772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:07.813666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:07.814366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:07.980197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:07.993193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-94585b7c-7bcf-4ba9-b666-9a89695de9ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.193001 May 31 18:26:07.994073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 96/190] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:07 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:08.033235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:08.035549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:08.046874 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:08.047331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:08.048153 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:08.048599 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:08.135589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:08.139979 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c7e852d1-9f7f-4d0f-abb0-6fcc11831a9c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1223 microversion: 2.1 time: 0.111750 May 31 18:26:08.140592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 95/191] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:08 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:08.618064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:08.618592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:08.624905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:08.625347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:08.626109 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:08.626657 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:08.759422 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:08.767055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e80b574d-4dc8-4077-937b-541700d9c48e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.154317 May 31 18:26:08.767626 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 97/192] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:08 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:09.011171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:09.011781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:09.018030 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:09.018480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:09.019668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:09.019785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:09.156488 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:09.158582 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:09.158974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:09.159195 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:09.168693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-eee6a74e-5910-41cc-9425-809f32e8358d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.160959 May 31 18:26:09.169344 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 96/193] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:09 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:09.172072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:09.172564 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:09.173470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:09.173914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:09.241005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:09.248723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9fa763ac-25fb-49e5-9a5b-f0dcd70aaca9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1223 microversion: 2.1 time: 0.094010 May 31 18:26:09.249632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 98/194] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:09 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:09.787569 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:09.788313 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:09.795822 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:09.796473 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:09.797422 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:09.797929 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:10.063331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:10.076780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-26b85830-7635-475b-8d61-779ce96e08bc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.292785 May 31 18:26:10.079418 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 97/195] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:09 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:10.186556 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:10.187268 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:10.194527 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:10.195111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:10.195945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:10.196494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:10.273634 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:10.274988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:10.282566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:10.283793 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:10.285778 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:10.286481 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:10.379506 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:10.387615 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bd54650b-9573-4abb-b6e9-8506dbbf3511 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1271 microversion: 2.1 time: 0.118674 May 31 18:26:10.388258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 98/196] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:10 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1271 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:10.406766 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:10.415309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8afe6ffd-2b8f-4e80-b14a-5ac71031789a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.232481 May 31 18:26:10.415884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 99/197] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:10 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:11.098765 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:11.099643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:11.107140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:11.107606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:11.108424 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:11.108942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:11.414396 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:11.418575 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:11.420523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:11.422295 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-30c6fa8f-9f35-48fd-a54d-bf9d9113773b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.329030 May 31 18:26:11.423032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 99/198] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:11 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:11.441984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:11.442442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:11.443300 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:11.443537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:11.443744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:11.444244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:11.451801 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:11.452862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:11.453934 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:11.454517 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:11.477022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:11.561395 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:11.573813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-48dc2772-3c5b-4e99-9fe6-086f4ec8a2c7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1277 microversion: 2.1 time: 0.167642 May 31 18:26:11.587452 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 100/199] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:11 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:11.735997 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:11.745411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-046e99cc-af56-4849-943b-99fb2b77054d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.308204 May 31 18:26:11.754766 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 100/200] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:11 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:12.441537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:12.442458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:12.449086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:12.449533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:12.450311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:12.450745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:12.593449 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:12.593449 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:12.626067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:12.626879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:12.628534 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:12.628841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:12.629359 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:12.643646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d9d6fb65-47d8-4742-9829-2c18f05e7880 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.206233 May 31 18:26:12.644680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 101/201] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:12 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:12.762546 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:12.763309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:12.769914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:12.770454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:12.771351 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:12.771857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:12.805872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:12.813917 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-631d39da-49a7-4a4b-83dc-5ac17b5d8600 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.224973 May 31 18:26:12.814485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 101/202] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:12 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:12.919460 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:12.928192 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-83438e96-960f-4800-a41d-098ab85ef48e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.169606 May 31 18:26:12.928796 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 102/203] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:12 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:13.663399 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:13.664017 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:13.670666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:13.671222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:13.672045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:13.672540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:13.808214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:13.816436 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a2809ec4-357b-4372-9be6-298d38544404 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.157275 May 31 18:26:13.816858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 102/204] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:13 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:13.830789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:13.832181 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:13.838828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:13.839283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:13.840064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:13.840535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:13.944586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:13.945371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:13.951612 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:13.952064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:13.952891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:13.953326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:14.319725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:14.327295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-462c696a-722d-4dd9-9340-b60dcc170912 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.500242 May 31 18:26:14.328270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 103/205] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:13 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:14.496479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:14.504413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b2829167-d75e-489f-b135-a212cf9151eb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.564267 May 31 18:26:14.505173 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 103/206] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:13 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:14.833711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:14.834592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:14.837776 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:14.844213 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:14.844666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:14.845447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:14.845892 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:14.902502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-6dde22cc-ae08-44fe-a6f8-6452452440fd req-5f632b1d-f09e-482a-b158-72a8020dad30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31b0a74e-7d2a-4cde-878d-ecf37360b6e7", "tag": "b7992847-af7b-4732-b099-891ac841b342"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:14.917946 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-6dde22cc-ae08-44fe-a6f8-6452452440fd req-5f632b1d-f09e-482a-b158-72a8020dad30 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:14.918603 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-6dde22cc-ae08-44fe-a6f8-6452452440fd req-5f632b1d-f09e-482a-b158-72a8020dad30 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:14.930722 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-6dde22cc-ae08-44fe-a6f8-6452452440fd req-5f632b1d-f09e-482a-b158-72a8020dad30 service nova] Creating event network-changed:b7992847-af7b-4732-b099-891ac841b342 for instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 on hv-cinder-83979 May 31 18:26:14.936321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-6dde22cc-ae08-44fe-a6f8-6452452440fd req-5f632b1d-f09e-482a-b158-72a8020dad30 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040466 May 31 18:26:14.936966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 104/207] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:26:15.012587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:15.021232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-55663bbe-172e-4eba-a05f-2221cd41d7c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.192045 May 31 18:26:15.022176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 104/208] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:14 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:15.347800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:15.348532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:15.359889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:15.360840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:15.363088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:15.363648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:15.524494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:15.526106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:15.533746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:15.534242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:15.535311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:15.535745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:15.605530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:15.613486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a5270123-f62e-417c-8854-eea00a839ce7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.271049 May 31 18:26:15.614055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 105/209] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:15 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:15.729895 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:15.738784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-29e4cc60-3700-4424-931f-df076eb7583f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.220399 May 31 18:26:15.739378 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 105/210] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:15 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:16.041091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:16.041798 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:16.049178 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.050246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.051259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.051761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.294323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:16.303191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-554c1037-9a68-4115-bd86-15ee4c231e4a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.265806 May 31 18:26:16.313241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 106/211] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:16 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:16.637557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:16.638415 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:16.645411 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.646095 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.647213 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.647836 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.676628 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-9ac978f8-dcfd-41e2-be78-080bb1c80251 req-17fc2143-20ce-4afd-a2b1-3cb70e1f917d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce4716-e4ed-4951-93cc-659e5bc96a0a", "name": "network-vif-plugged", "status": "completed", "tag": "fd7a8955-5a11-452e-a3ac-edc9f5503349"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:16.687955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9ac978f8-dcfd-41e2-be78-080bb1c80251 req-17fc2143-20ce-4afd-a2b1-3cb70e1f917d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.691921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9ac978f8-dcfd-41e2-be78-080bb1c80251 req-17fc2143-20ce-4afd-a2b1-3cb70e1f917d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.721011 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-9ac978f8-dcfd-41e2-be78-080bb1c80251 req-17fc2143-20ce-4afd-a2b1-3cb70e1f917d service nova] Creating event network-vif-plugged:fd7a8955-5a11-452e-a3ac-edc9f5503349 for instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a on hv-cinder-83979 May 31 18:26:16.727857 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-9ac978f8-dcfd-41e2-be78-080bb1c80251 req-17fc2143-20ce-4afd-a2b1-3cb70e1f917d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056839 May 31 18:26:16.730165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 107/212] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:26:16.764841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:16.768695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:16.783079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:16.793829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=12 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:16.805214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.805962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.806866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:16.807689 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:16.851865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:16.860491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3f21c279-7b71-4100-813a-74918cc3d6da tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.226796 May 31 18:26:16.861215 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 106/213] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:16 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:16.988912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:16.996489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c86c78d0-1ff0-41c5-846a-21fc5142ddc5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.244855 May 31 18:26:16.997069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 108/214] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:16 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:17.321809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:17.322457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:17.324814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=4 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:17.331621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:17.332359 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:17.333101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:17.334051 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:17.473816 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:17.482221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-54bb2c00-a208-486f-928f-2e8587acd2ef tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.164643 May 31 18:26:17.482791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 107/215] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:17 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:17.877421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:17.883182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:17.887045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:17.887539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:17.888334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:17.888768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:18.014573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:18.015187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:18.021981 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:18.022435 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:18.023225 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:18.023654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:18.048547 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:18.057690 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fd5a5e05-bebb-4d95-9b38-274234d0f2a0 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.184048 May 31 18:26:18.058620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 109/216] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:17 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:18.203679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:18.214011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-397a4a2a-fd73-4a13-96b0-39b8af1611af tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.202726 May 31 18:26:18.214932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 108/217] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:18 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:18.501793 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:18.502403 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:18.509212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:18.509657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:18.510421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:18.510851 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:18.658550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:18.669604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-36e5aca0-d199-476b-850c-b5de2256dae5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.171534 May 31 18:26:18.670217 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 110/218] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:18 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:19.075849 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:19.076475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:19.083801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:19.084283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:19.085059 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:19.085493 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:19.228769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:19.230671 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:19.231961 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:19.234347 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:19.236615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7fc5c54f-5194-4c42-aa37-61d3b263d03e tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.164535 May 31 18:26:19.237301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 109/219] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:19 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:19.239914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:19.240391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:19.241344 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:19.241870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:19.380626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:19.388610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8fe3b954-8705-4d7f-a5fc-c7ebb603d8df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.161619 May 31 18:26:19.389195 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 111/220] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:19 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:19.688391 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:19.689111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:19.696916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:19.697371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:19.698606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:19.699163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:19.849197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:19.856983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9f0b53b4-602a-4491-984c-48b0307a1d5c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.173127 May 31 18:26:19.857566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 110/221] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:19 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:20.253621 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:20.254235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:20.261218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:20.261675 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:20.262447 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:20.262888 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:20.405409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:20.406232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:20.413683 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:20.414126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:20.414913 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:20.415372 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:20.420604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:20.428883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-201c6d85-fe26-4f94-b80e-abab5f381252 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.179144 May 31 18:26:20.429469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 112/222] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:20 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:20.594486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:20.603731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c9b38dcb-9c3b-4047-bc62-0724458c93a8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.202088 May 31 18:26:20.614549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 111/223] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:20 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:20.876600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:20.878363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:20.887058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:20.887640 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:20.888559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:20.889069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:21.057991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:21.066548 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4e49f1c3-32c3-4e1c-a36d-9ed1271fcf8c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.195576 May 31 18:26:21.067126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 113/224] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:20 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:21.447489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:21.448143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:21.454148 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:21.454596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:21.455360 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:21.456608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:21.600822 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:21.608455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-35e7592a-cc1c-4346-992d-b4416654faa9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.164911 May 31 18:26:21.609030 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 112/225] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:21 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:21.622582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:21.623233 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:21.631261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:21.631697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:21.634182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:21.634182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:21.773926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:21.776114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:21.782910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b18d2850-049a-46bb-9d2c-cb93521b0c36 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1314 microversion: 2.1 time: 0.164182 May 31 18:26:21.783578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 114/226] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:21 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:22.082721 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:22.083239 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:22.089434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.089878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.090646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.091075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.278232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:22.294744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-80e0f30d-4ebc-4f76-93b1-399c7b6172e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.215840 May 31 18:26:22.295341 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 113/227] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:22 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:22.628423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:22.629774 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:22.643358 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.644808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.646157 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.647142 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.782096 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-4876bcfa-0f12-4f40-88f4-fa41821fbb56 req-7c9091f0-0d81-4ffa-b0e3-b2d803ce3c4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b0a74e-7d2a-4cde-878d-ecf37360b6e7", "name": "network-vif-plugged", "status": "completed", "tag": "b7992847-af7b-4732-b099-891ac841b342"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:22.795665 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-4876bcfa-0f12-4f40-88f4-fa41821fbb56 req-7c9091f0-0d81-4ffa-b0e3-b2d803ce3c4c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.796366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-4876bcfa-0f12-4f40-88f4-fa41821fbb56 req-7c9091f0-0d81-4ffa-b0e3-b2d803ce3c4c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.821269 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-4876bcfa-0f12-4f40-88f4-fa41821fbb56 req-7c9091f0-0d81-4ffa-b0e3-b2d803ce3c4c service nova] Creating event network-vif-plugged:b7992847-af7b-4732-b099-891ac841b342 for instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 on hv-cinder-83979 May 31 18:26:22.828636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-4876bcfa-0f12-4f40-88f4-fa41821fbb56 req-7c9091f0-0d81-4ffa-b0e3-b2d803ce3c4c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050021 May 31 18:26:22.829696 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 114/228] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:26:22.843070 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:22.844630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:22.855843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.856716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.858414 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:22.859370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:22.957423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:22.975420 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-02ee8a62-a875-49fc-87b8-57de86c75e54 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.351740 May 31 18:26:22.976012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 115/229] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:22 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:23.148516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:23.156636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-99dcd001-c8d3-468c-97de-af05999f151c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1498 microversion: 2.1 time: 0.324669 May 31 18:26:23.157209 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 115/230] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:22 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1498 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:23.321817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:23.322489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:23.329503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:23.329958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:23.331385 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:23.331827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:23.536903 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:23.554848 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ceb0af0b-26ef-4426-980c-1108f36cbf67 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.236799 May 31 18:26:23.555829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 116/231] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:23 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:23.803367 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:23.803913 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:23.811402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:23.811841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:23.812690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:23.813120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:23.842177 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:26:23.868172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:23.923907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f4cd6035-6a00-44d9-9382-4fcf7c8113b1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "DELETE /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 204 len: 0 microversion: 2.1 time: 0.124534 May 31 18:26:23.930180 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 116/232] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:26:23 2022] DELETE /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:26:23.935381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:23.936013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:23.946285 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:23.946887 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:23.947680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:23.948136 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:23.995955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:23.996720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:24.006713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:24.007162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:24.007932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:24.008533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:24.249446 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:24.257758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-961d6721-711a-498f-b982-d56e81320f26 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1504 microversion: 2.1 time: 0.326289 May 31 18:26:24.258896 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 117/233] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:23 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:24.280525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:24.291869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4228f863-1be5-49fd-91f4-7fe230bd5859 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.300089 May 31 18:26:24.292463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 117/234] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:23 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:24.572577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:24.573218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:24.579463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:24.579920 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:24.581383 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:24.581904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:24.762039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:24.770319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-947c3c8c-6f00-4a54-8a54-052acda15545 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.202607 May 31 18:26:24.771131 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 118/235] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:24 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:25.276140 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:25.277010 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:25.284327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:25.284327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:25.285444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:25.285870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:25.311569 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:25.312389 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:25.321609 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:25.322172 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:25.324178 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:25.324699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:25.532328 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:25.539505 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-963cc8f6-90b5-4db1-a7e9-ce4bef22c62d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1504 microversion: 2.1 time: 0.267066 May 31 18:26:25.540114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 118/236] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:25 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:25.544126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:25.558944 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7249ba75-3e0e-4681-8d7a-73a951315934 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1319 microversion: 2.1 time: 0.250870 May 31 18:26:25.560002 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 119/237] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:25 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1319 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:25.788579 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:25.789186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:25.795375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:25.796006 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:25.797221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:25.797885 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:25.947137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:25.958942 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-29d447a2-5a8a-4693-bd46-dd0f284af972 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.175004 May 31 18:26:25.960017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 119/238] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:25 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:26.556073 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:26.556834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:26.564271 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:26.565381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:26.565972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:26.566655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:26.586874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:26.587735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:26.597348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:26.597348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:26.597348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:26.597348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:26.819112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:26.823715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:26.827220 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-61695c0d-72a5-4b0d-829d-da2455465608 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1508 microversion: 2.1 time: 0.251446 May 31 18:26:26.827884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 120/239] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:26 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1508 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:26.832335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1069e1f8-0847-4a86-81d1-0fd65af96a97 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1504 microversion: 2.1 time: 0.280168 May 31 18:26:26.832900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 120/240] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:26 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:26.980587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:26.981431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:26.989848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:26.990297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:26.991068 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:26.991497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:27.242572 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:27.255533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-24fff485-f90f-4c1a-aa46-8dcb3afd718f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.281065 May 31 18:26:27.284295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 121/241] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:26 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:27.683863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-6b61b3db-9d9f-4db4-aea8-04e78c5a3109 req-2755dfb0-52b5-4b46-8c95-47711a5ac78f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cce4716-e4ed-4951-93cc-659e5bc96a0a", "name": "network-vif-deleted", "tag": "fd7a8955-5a11-452e-a3ac-edc9f5503349"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:27.696407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-6b61b3db-9d9f-4db4-aea8-04e78c5a3109 req-2755dfb0-52b5-4b46-8c95-47711a5ac78f service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:27.697222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-6b61b3db-9d9f-4db4-aea8-04e78c5a3109 req-2755dfb0-52b5-4b46-8c95-47711a5ac78f service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:27.712647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-6b61b3db-9d9f-4db4-aea8-04e78c5a3109 req-2755dfb0-52b5-4b46-8c95-47711a5ac78f service nova] Creating event network-vif-deleted:fd7a8955-5a11-452e-a3ac-edc9f5503349 for instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a on hv-cinder-83979 May 31 18:26:27.720415 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-6b61b3db-9d9f-4db4-aea8-04e78c5a3109 req-2755dfb0-52b5-4b46-8c95-47711a5ac78f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040527 May 31 18:26:27.721725 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 121/242] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:26:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:26:27.849281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:27.850048 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:27.862878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:27.863479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:27.864355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:27.864787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:27.899236 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:27.899687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:27.900171 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lazy-loading 'fault' on Instance uuid 7cce4716-e4ed-4951-93cc-659e5bc96a0a {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:26:27.954346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:27.962618 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2321f897-ec0c-48e0-a644-d1886b9a68e8 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 200 len: 1304 microversion: 2.1 time: 0.117087 May 31 18:26:27.963110 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 122/243] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:27 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 1304 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:28.277180 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:28.277932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:28.285129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:28.285585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:28.286371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:28.286867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:28.430388 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:28.437866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-75d61689-a870-4c12-918c-4df9fbaae3bf tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.164918 May 31 18:26:28.438438 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 122/244] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:28 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:28.980123 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:28.980736 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 7cce4716-e4ed-4951-93cc-659e5bc96a0a] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:28.987259 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:28.987735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:28.988553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:28.988992 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:29.003804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] HTTP exception thrown: Instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a could not be found. May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Request method failure captured: May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a HTTP/1.1 May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill22-SGMR48Xr7NHeuEwDacY6eayy3jl_-JlS4df279YKRXGxqjYDYlA5riv5P_ddHhMjgBOpLCTm0TcQYIPM0fU-8GF1T9m_9ZCiBOVafH-eEAJLUiPTRqLyE7ISphyGmZi9I5FKKvzeo5-PcLog_Ql4HDVaVuUdALFS5Aef4ArWaU May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 7ea31516b7864535b1469752615237f6 May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesActionsTest-255486724 May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:26:29.008646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea31516b7864535b1469752615237f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea31516b7864535b1469752615237f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea31516b7864535b1469752615237f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea31516b7864535b1469752615237f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesActionsTest-255486724 May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 7ea31516b7864535b1469752615237f6 May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesActionsTest-255486724 May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesActionsTest-255486724-project May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 679646d952c94748af853799d5d39cc9 May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesActionsTest-255486724-project May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a could not be found. May 31 18:26:29.009933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '7cce4716-e4ed-4951-93cc-659e5bc96a0a'} May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a could not be found. May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:26:29.010598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a could not be found. May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a could not be found. May 31 18:26:29.011829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:26:29.013031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Returning 404 to user: Instance 7cce4716-e4ed-4951-93cc-659e5bc96a0a could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:26:29.013031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ba53d3bd-b443-433a-91ba-e4d44819f5bb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a" status: 404 len: 111 microversion: 2.1 time: 0.033887 May 31 18:26:29.013031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 123/245] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:28 2022] GET /compute/v2.1/servers/7cce4716-e4ed-4951-93cc-659e5bc96a0a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:26:29.115760 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-446602872", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "networks": [{"uuid": "48a96cbd-25b4-4538-9358-140c1ffcd2f8"}]}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:29.454743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:29.455387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:29.461634 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:29.462082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:29.462856 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:29.463295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:29.607731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:29.617644 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-78ac925e-74ac-4149-ae3c-f5064482bc5f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.166715 May 31 18:26:29.618214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 124/246] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:29 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:30.634876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:30.635642 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:30.641736 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:30.642184 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:30.642991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:30.643423 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:30.778640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:30.786616 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5d8f0fa0-5a1c-4d75-9255-f5754db383f3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.155838 May 31 18:26:30.787182 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 125/247] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:30 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:31.803610 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:31.804325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:31.811335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:31.811783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:31.812584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:31.813014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:31.946329 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:31.955244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c34faf1e-3364-4c0a-8f83-eae107d9724c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.155414 May 31 18:26:31.956103 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 126/248] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:31 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:32.973249 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:32.973882 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:32.980004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:32.980476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:32.981243 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:32.981671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:33.119742 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:33.128150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-baacfc05-653f-49b9-a616-f71f6bba4d21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.159371 May 31 18:26:33.128740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 127/249] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:32 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:34.151350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:34.152252 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:34.159177 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:34.159628 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:34.160496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:34.160875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:34.309600 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:34.319202 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2a88356b-c43c-471c-bee9-c78c89ef72cb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.177047 May 31 18:26:34.319852 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 128/250] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:34 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:35.338993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:35.340316 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:35.352878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:35.353443 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:35.354282 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:35.354682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:35.777850 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:35.786563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-39f4c593-7ebb-4ed8-b48a-aa7136413146 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.453454 May 31 18:26:35.787159 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 129/251] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:35 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:36.089727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] validate_networks() for [('48a96cbd-25b4-4538-9358-140c1ffcd2f8', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:26:36.465148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:26:36.465840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:26:36.466930 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:26:36.466930 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:26:36.467308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:26:36.479774 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:36.480163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:36.481353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:36.482006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:36.504013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Getting quotas for project 7ea31516b7864535b1469752615237f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:26:36.508832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Getting quotas for user 679646d952c94748af853799d5d39cc9 and project 7ea31516b7864535b1469752615237f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:26:36.520665 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:26:36.522951 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:26:36.576887 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-21326c6a-c906-4261-b54f-eef9bf0945df tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.465345 May 31 18:26:36.578738 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 123/252] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 7468 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:26:36.596588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-55c5b7bd-a73a-40d3-9f17-886a930b0da2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:36.597005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-55c5b7bd-a73a-40d3-9f17-886a930b0da2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:36.659323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-55c5b7bd-a73a-40d3-9f17-886a930b0da2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:36.666719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-55c5b7bd-a73a-40d3-9f17-886a930b0da2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1213 microversion: 2.1 time: 0.080599 May 31 18:26:36.667421 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 130/253] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:36 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:36.805909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:36.806781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:36.813241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:36.813685 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:36.814707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:36.815141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:36.968299 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:36.976884 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a17f57ef-d940-4723-a850-a39f2d431f80 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.175494 May 31 18:26:36.977565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 124/254] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:36 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:37.692361 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:37.692361 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:37.698076 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:37.698524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:37.699298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:37.699733 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:37.766812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:37.774663 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a1d97f56-d845-4aa2-b08f-cc7fcf2115f0 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1217 microversion: 2.1 time: 0.089245 May 31 18:26:37.775237 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 131/255] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:37 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:37.995813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:37.996465 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:38.003407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:38.003852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:38.004664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:38.005098 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:38.145473 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:38.153004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-40dde9f5-2721-40df-8cfe-55c0b70cbd12 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.160916 May 31 18:26:38.153575 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 125/256] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:37 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:38.791884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:38.792527 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:38.799993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:38.800470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:38.801255 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:38.801707 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:38.868594 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:38.876040 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-55a2d6a1-908d-490c-b76d-9151290e5769 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1217 microversion: 2.1 time: 0.088086 May 31 18:26:38.876640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 132/257] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:38 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:39.170888 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:39.171505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:39.178613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:39.179054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:39.182913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:39.182913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:39.323821 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:39.328173 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cfa34b90-071a-4031-bc64-5a86335bcd3f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.161064 May 31 18:26:39.328866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 126/258] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:39 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:39.893012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:39.893789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:39.900028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:39.900500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:39.901274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:39.901705 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:39.964990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:39.967331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:39.974409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5e7b56fe-85b8-4018-bc6e-dd5e00776e6e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1217 microversion: 2.1 time: 0.085840 May 31 18:26:39.974984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 133/259] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:39 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:40.346081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:40.346689 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:40.353346 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:40.353794 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:40.354574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:40.355015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:40.500574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:40.509125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4b751212-f045-49fb-84d1-fb85fc16b789 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.166881 May 31 18:26:40.509708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 127/260] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:40 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:40.991938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:40.992567 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:40.999248 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:40.999691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:41.000500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:41.000927 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:41.075812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:41.084938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e15408ca-d3ad-4ce2-9cbd-e3f6cac0d73f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1217 microversion: 2.1 time: 0.097162 May 31 18:26:41.085541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 134/261] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:40 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1217 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:41.529415 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:41.530433 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:41.538399 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:41.538842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:41.539613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:41.540041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:41.677240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:41.685250 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7bf58695-e394-430f-8592-2a3cec947ad2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.162979 May 31 18:26:41.685833 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 128/262] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:41 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:42.102299 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:42.102954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:42.111803 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:42.112293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:42.113111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:42.113545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:42.181382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:42.189971 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-975ed466-61e7-4751-9262-dc8a91bcd3b7 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1265 microversion: 2.1 time: 0.090785 May 31 18:26:42.190777 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 135/263] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:42 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1265 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:42.703933 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:42.705213 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:42.712871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:42.713316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:42.714075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:42.714504 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:42.861391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:42.869883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0f4fb990-bc2f-4e39-8e8e-5fa86f4c80f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.170821 May 31 18:26:42.870735 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 129/264] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:42 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:43.206997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:43.207603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:43.213931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:43.214384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:43.215265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:43.215697 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:43.288761 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:43.303218 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2798966f-4853-4a33-8399-d0f2f2bbec34 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.099855 May 31 18:26:43.304608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 136/265] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:43 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:43.888026 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:43.888955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:43.897305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:43.897749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:43.898528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:43.898948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:44.046406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:44.057402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3fbd1d63-b03b-4c8b-af72-f7653857ab7d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.172963 May 31 18:26:44.058465 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 130/266] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:43 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:44.328662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:44.329477 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:44.340616 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:44.341072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:44.341947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:44.342271 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:44.415508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:44.425310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2c7ffbbb-f2d6-4a96-8197-e92c767061d1 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.100266 May 31 18:26:44.440380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 137/267] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:44 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:45.074869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:45.075565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:45.083606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:45.084071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:45.088134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:45.088134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:45.230125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:45.239172 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f985a95a-320d-4f52-9bdb-f1d10a0c2c05 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.168165 May 31 18:26:45.243045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 131/268] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:45 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:45.442748 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:45.443356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:45.445232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:45.450665 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:45.451120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:45.451877 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:45.452334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:45.540573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:45.546160 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4bbe2010-b05f-476d-b310-44b018f90041 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.107791 May 31 18:26:45.546994 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 138/269] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:45 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:46.259352 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:46.259955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:46.267656 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:46.268188 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:46.268916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:46.269346 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:46.443161 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:46.448780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:46.454105 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f42c4448-dbf8-4f52-81e0-a425b2b5d430 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.199664 May 31 18:26:46.464315 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 132/270] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:46 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:46.563406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:46.564072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:46.572336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:46.572336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:46.573120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:46.573550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:46.638150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:46.646534 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3d4ca61a-81e3-4638-8105-26ddffd9e94b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.087130 May 31 18:26:46.647104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 139/271] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:46 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:47.472046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:47.472676 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:47.474482 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:47.475144 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:47.481761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:47.482200 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:47.482975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:47.483417 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:47.648455 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:47.660424 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6d1e5a1a-e259-4394-a92e-6a2f2d446daa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.192396 May 31 18:26:47.661014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 133/272] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:47 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:47.663552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:47.664458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:47.666588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:47.674456 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:47.674924 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:47.675780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:47.676162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:47.748974 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:47.758017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7e2cc89f-b236-49b2-b9bf-074e1a1cd1f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.099088 May 31 18:26:47.758604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 140/273] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:47 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:48.681067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:48.681895 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:48.690146 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:48.690146 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:48.690875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:48.691317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:48.776311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:48.776985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:48.783763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:48.784263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:48.785020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:48.785457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:48.869185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:48.874561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:48.877352 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-16324b08-591a-41f2-8991-bb356e3d8603 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.104852 May 31 18:26:48.877928 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 141/274] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:48 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:48.882908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d0d6dc56-9af5-443d-b920-c0519c3e7afb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.206884 May 31 18:26:48.883521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 134/275] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:48 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:49.899557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:49.900465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:49.900991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:49.901616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:49.904193 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:49.911530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:49.911982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:49.912798 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:49.913235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:49.913333 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:49.913794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:49.914764 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:49.915243 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:50.015550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:50.026654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-eceb70af-45b2-41c0-a771-fa2922a34a05 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1273 microversion: 2.1 time: 0.131031 May 31 18:26:50.027247 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 142/276] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:49 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1273 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:50.089014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:50.098462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-58c67336-fa35-476a-8849-ece64f8b3e2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.201294 May 31 18:26:50.099073 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 135/277] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:49 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:51.047770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:51.048560 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:51.054742 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:51.055191 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:51.056004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:51.056465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:51.120571 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:51.121286 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:51.138140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:51.138680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:51.139743 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:51.141367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:51.218104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:51.226528 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-50bc2293-a0f6-42b0-a557-bb5239064f0a tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1271 microversion: 2.1 time: 0.184830 May 31 18:26:51.227198 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 143/278] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:51 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1271 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:51.422532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:51.430611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cc66b2a2-36d5-4388-b17a-0790a4949952 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.318651 May 31 18:26:51.431327 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 136/279] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:51 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:52.244512 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:52.245242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:52.252714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:52.253235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:52.254024 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:52.254655 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:52.449008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:52.449756 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:52.457958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:52.458601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:52.459713 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:52.460225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:52.498378 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:52.506983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b5d63e6d-2e3c-451d-a57e-8d501ca2d8fb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.266511 May 31 18:26:52.507667 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 144/280] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:52 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:52.744461 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:52.752979 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b5cb2bc8-cd1b-43be-be32-a2005faec6ed tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.307831 May 31 18:26:52.753454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 137/281] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:52 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:53.204911 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-d7bd32fe-c11d-4638-98b7-2df21b7b0eb1 req-86c20929-8dc8-4255-9a75-bb78fc00ebda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19c2ea84-984c-40c5-8ea9-2909f9340381", "tag": "3a257836-88f4-48d7-992d-e63ef214d030"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:26:53.213483 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-d7bd32fe-c11d-4638-98b7-2df21b7b0eb1 req-86c20929-8dc8-4255-9a75-bb78fc00ebda service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:53.213915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-d7bd32fe-c11d-4638-98b7-2df21b7b0eb1 req-86c20929-8dc8-4255-9a75-bb78fc00ebda service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:53.231244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-d7bd32fe-c11d-4638-98b7-2df21b7b0eb1 req-86c20929-8dc8-4255-9a75-bb78fc00ebda service nova] Creating event network-changed:3a257836-88f4-48d7-992d-e63ef214d030 for instance 19c2ea84-984c-40c5-8ea9-2909f9340381 on hv-cinder-83979 May 31 18:26:53.237138 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-d7bd32fe-c11d-4638-98b7-2df21b7b0eb1 req-86c20929-8dc8-4255-9a75-bb78fc00ebda service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036658 May 31 18:26:53.238007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 145/282] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:26:53.525847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:53.526836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:53.534634 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:53.535057 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:53.535833 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:53.536305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:53.679955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:53.688213 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-718a1f75-f252-48c3-a496-5231663d120f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.166485 May 31 18:26:53.688832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 138/283] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:53 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:53.771249 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:53.772223 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:53.780402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:53.780909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:53.781698 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:53.782777 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:53.927191 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:53.934872 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e38b94d1-aa7d-407d-ac74-b9c7c8db2438 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.168258 May 31 18:26:53.935450 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 146/284] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:53 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:26:54.705954 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:54.706540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:54.715321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:54.716172 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:54.717436 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:54.718173 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:54.866058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:54.873681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-29d03c79-7f72-45f3-9f33-04b78e96a43b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.172751 May 31 18:26:54.874260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 139/285] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:54 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:54.952113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:54.952783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:54.959993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:54.960464 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:54.961248 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:54.961690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:55.109708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:55.118106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-db7176aa-8aea-4e1a-b3e1-1936544de3b2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.169860 May 31 18:26:55.118597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 147/286] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:54 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:55.891308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:55.893292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:55.899435 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:55.899881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:55.900918 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:55.901364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:56.055916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:56.064561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0f89d730-5a56-416d-9e41-53779fc63a4e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.177457 May 31 18:26:56.065206 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 140/287] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:55 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:56.136843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:56.137451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:56.144578 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:56.145020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:56.145792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:56.146226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:56.287649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:56.295380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1f0cb9e2-bb2e-4d23-927f-c64aef71ee02 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.162239 May 31 18:26:56.295950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 148/288] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:56 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:57.082847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:57.083693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:57.090606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:57.091056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:57.091827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:57.092293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:57.238336 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:57.246129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4f67fe04-3867-4b07-ad1c-0f20c7ff6b79 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.168602 May 31 18:26:57.246709 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 141/289] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:57 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:57.312927 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:57.314791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:57.320184 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:57.320628 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:57.321390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:57.321822 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:57.465625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:57.473320 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5870252a-f4be-4b96-96c3-44b821a813d5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.164210 May 31 18:26:57.473891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 149/290] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:57 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:58.263879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:58.264515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:58.274756 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:58.275194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:58.275964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:58.276426 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:58.412629 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:58.420453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ead2096c-8a0b-4dfe-afb9-e77da72ed490 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.160277 May 31 18:26:58.421034 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 142/291] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:58 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:58.490297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:58.490835 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:58.497109 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:58.497560 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:58.498343 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:58.498783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:58.641008 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:58.649398 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-949e4205-03dd-4937-8082-1619e76700b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.162905 May 31 18:26:58.649974 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 150/292] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:58 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:59.437594 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:59.438809 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:59.445798 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:59.446241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:59.447002 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:59.447435 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:59.588713 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:59.601784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c2b4c5c1-41be-4aae-bbe2-2acc6199eb5f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.168177 May 31 18:26:59.602376 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 143/293] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:59 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:26:59.666566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:26:59.667162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:26:59.675997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:59.676533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:59.677319 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:26:59.677908 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:26:59.681528 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:26:59.974434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:26:59.982020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a5ba8570-3c49-49ed-a370-530ebeca3f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1521 microversion: 2.1 time: 0.319202 May 31 18:26:59.982634 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 151/294] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:26:59 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:00.623544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:00.624443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:00.632957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:00.633466 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:00.634243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:00.634674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:00.790971 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:00.799362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3fa0312b-dbe0-4f43-8007-cac5f4a82941 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.181196 May 31 18:27:00.800107 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 144/295] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:00 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:01.001826 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:01.002615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:01.010155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:01.019922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:01.021356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:01.021874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:01.430987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:01.439656 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-55bf778a-286a-4c4a-876d-3743931c70b1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1501 microversion: 2.1 time: 0.443800 May 31 18:27:01.440289 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 152/296] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:00 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1501 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:01.458029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:01.458650 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:01.465158 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:01.465613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:01.466410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:01.466867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:01.817075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:01.817648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:01.823974 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:01.824463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:01.825263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:01.825694 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:01.850863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:01.858629 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-caddab17-af1c-4e07-b9e3-bafe289df976 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1514 microversion: 2.1 time: 0.405416 May 31 18:27:01.859252 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 145/297] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:01 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1514 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:02.143853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:02.155257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-602ea3f4-e9b1-4f39-97ec-f5e4e353b743 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.342703 May 31 18:27:02.156280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 153/298] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:01 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:03.171894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:03.173138 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:03.179914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:03.180390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:03.181164 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:03.181600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:03.342199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:03.350527 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3974c7e7-cd45-436f-91e5-6d6137d18daf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.182518 May 31 18:27:03.351113 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 146/299] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:03 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:04.369008 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:04.369716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:04.376228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:04.376754 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:04.377540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:04.377975 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:04.512843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:04.520974 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f5a6c2f4-0e9a-46e9-98bf-d2dbd0c4d36c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.155699 May 31 18:27:04.521553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 154/300] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:04 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:05.538411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:05.539033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:05.545837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:05.546294 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:05.547704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:05.548184 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:05.691703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:05.699329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a72572c9-8a56-4cb9-8d6e-56d7a5e64d5e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.164814 May 31 18:27:05.699880 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 147/301] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:05 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:06.716876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:06.717648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:06.725081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:06.725516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:06.726294 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:06.726726 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:06.875617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:06.877980 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-207eb880-499b-4e67-b083-da69e9acc945 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.165056 May 31 18:27:06.878654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 155/302] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:06 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:07.894296 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:07.895016 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:07.901845 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:07.902299 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:07.903071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:07.903509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:08.034881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:08.042502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-20715f16-f8e0-487a-bc2c-4cb323d2485e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.152163 May 31 18:27:08.048185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 148/303] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:07 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:08.603832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:27:08.604787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:08.611990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:08.612450 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:08.613222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:08.613658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:08.636274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lazy-loading 'flavor' on Instance uuid abf24b7e-be1e-4235-a568-b5679595a5bd {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:27:08.711263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-eeec903f-dca6-40ba-a5c5-02504631252b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/action" status: 200 len: 32 microversion: 2.1 time: 0.111465 May 31 18:27:08.711865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 156/304] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:27:08 2022] POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/action => generated 32 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:27:08.721686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:08.722301 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:08.728377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:08.728824 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:08.729588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:08.730024 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:08.749563 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:08.876982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:08.884825 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-318c5f34-e293-42bc-9eeb-a43fd4498f36 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.167783 May 31 18:27:08.885394 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 149/305] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:08 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:09.060187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:09.060913 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:09.067869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:09.068350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:09.069118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:09.069554 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:09.203193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:09.210781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5dc0ac4c-0419-4ac7-84ec-cfe8d371cb4f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.154792 May 31 18:27:09.211312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 157/306] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:09 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:09.902974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:09.903688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:09.910617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:09.910847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:09.911607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:09.912036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:10.058891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:10.066940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5ff946a9-07eb-41c8-b329-b4d42639fc90 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.168128 May 31 18:27:10.067506 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 150/307] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:09 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:10.227713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:10.228346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:10.234205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:10.234738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:10.235522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:10.235950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:10.391598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:10.399378 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4bf851d0-04de-480a-8592-7b68dc067467 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.175343 May 31 18:27:10.400020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 158/308] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:10 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:11.086393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:11.087695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:11.094679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:11.095584 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:11.096587 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:11.097476 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:11.342258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:11.350686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c0c45b94-d4cf-44e9-88d1-f19d37340602 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.268506 May 31 18:27:11.351258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 151/309] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:11 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:11.416416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:11.417246 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:11.423818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:11.424339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:11.425122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:11.425565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:11.658895 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:11.666353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ee6f4ac4-8606-4b22-bb82-3182496e2555 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.254063 May 31 18:27:11.666916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 159/310] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:11 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:12.367836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:12.368474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:12.374988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:12.375458 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:12.376311 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:12.376748 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:12.505810 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:12.513777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-32b4141f-1f39-4e0f-9070-b83439b3554a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.149798 May 31 18:27:12.514353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 152/311] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:12 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:12.683532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:12.684165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:12.691020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:12.691471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:12.692283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:12.692725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:12.821786 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:12.829302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6f1d18ed-59c8-4fee-83c6-b88e95398a9f tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.149545 May 31 18:27:12.829870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 160/312] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:12 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:13.530492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:13.531483 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:13.537853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:13.538323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:13.539083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:13.539513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:13.679903 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:13.688792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c736d218-1aec-4a31-a724-645dcacce4bb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.162084 May 31 18:27:13.689358 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 153/313] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:13 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:13.846742 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:13.847564 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:13.853392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:13.853866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:13.854606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:13.855038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:13.988263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:13.996122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-248f2c1d-2ad2-48c4-af19-126d69c24d42 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.153584 May 31 18:27:13.996724 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 161/314] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:13 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:14.706888 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:14.707496 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:14.713977 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:14.714423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:14.715191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:14.715626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:14.857576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:14.867085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a8c5e6e8-b27b-464e-b3f9-7e9719ae16dd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.164937 May 31 18:27:14.867652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 154/315] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:14 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:15.013397 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:15.014003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:15.020267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:15.020715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:15.021480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:15.021916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:15.154492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:15.162670 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bae64470-8678-4052-b53d-61f8cb1eb2ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.153023 May 31 18:27:15.163231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 162/316] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:15 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:15.886550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:15.887259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:15.896413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:15.896869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:15.897645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:15.898077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:16.040197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:16.048227 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b5f98fdb-58cf-4e6a-9559-75ef0c33792d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.166484 May 31 18:27:16.048805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 155/317] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:15 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:16.179603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:16.180360 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:16.182076 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=50 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:16.188603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:16.189077 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:16.189851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:16.190279 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:16.341047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:16.349276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3936c31e-dda9-4fea-be3b-33751ee1ed68 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.173482 May 31 18:27:16.350071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 163/318] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:16 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:17.065565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:17.066171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:17.072664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:17.073091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:17.073853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:17.074280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:17.230444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:17.238856 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5f32fa13-d3a4-4e6c-bb39-47e1e131390c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.177868 May 31 18:27:17.239442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 156/319] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:17 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:17.366174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:17.366984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:17.374108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:17.375204 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:17.376225 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:17.376670 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:17.515338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:17.523253 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-75bb5112-f0c1-4c95-b99d-8da742abd889 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.160882 May 31 18:27:17.524193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 164/320] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:17 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:18.256914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:18.257551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:18.264283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:18.264731 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:18.266192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:18.266710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:18.413362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:18.421321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-867b81d0-63c2-4859-a285-94c781cceb32 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.168392 May 31 18:27:18.422107 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 157/321] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:18 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:18.541514 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:18.542267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:18.548615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:18.549073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:18.549840 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:18.550274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:18.728072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:18.730295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:18.740286 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3379357b-9ef4-4e1f-8b2b-9364d848ba55 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.202556 May 31 18:27:18.749937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 165/322] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:18 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:19.439183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:19.439792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:19.446264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:19.446709 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:19.447472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:19.447907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:19.573503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:19.581371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ce4edd07-4661-4735-9f6c-d30a63e09038 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.146822 May 31 18:27:19.581939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 158/323] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:19 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:19.757902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:19.758692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:19.766289 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:19.766728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:19.767496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:19.767925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:19.909073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:19.916474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9d5435ac-2ba0-436b-9eba-2bd1a8f948ed tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.162974 May 31 18:27:19.917036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 166/324] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:19 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:20.598483 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:20.599044 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:20.601335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=48 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:20.607557 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:20.608004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:20.609595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:20.610052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:20.747914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:20.756632 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f4dcca54-4e5a-4f31-8806-380ccefcb3b8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.162078 May 31 18:27:20.757220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 159/325] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:20 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:20.933444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:20.934070 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:20.941038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:20.941499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:20.942321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:20.942785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:21.076451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:21.084054 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aeaba933-8daa-4bc8-8fa7-9af201f08225 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.154462 May 31 18:27:21.084651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 167/326] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:20 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:21.774292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:21.774900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:21.781533 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:21.781980 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:21.782737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:21.783167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:21.925290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:21.932664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7090e63b-ec7f-4c1b-839e-aa86165f91cc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.162182 May 31 18:27:21.933232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 160/327] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:21 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:22.100781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:22.101456 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:22.107518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:22.107957 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:22.108818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:22.109541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:22.243659 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:22.252188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8bb000db-a099-4098-bcd0-0cb67675f330 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.155756 May 31 18:27:22.252791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 168/328] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:22 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:22.950977 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:22.951625 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:22.958605 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:22.959061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:22.959846 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:22.960331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:23.103429 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:23.111202 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-12bd61ac-2491-4c0b-9e4e-156e5b07a3da tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.164155 May 31 18:27:23.111771 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 161/329] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:22 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:23.269281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:23.269892 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:23.275892 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:23.276569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:23.277220 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:23.277653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:23.425658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:23.433975 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1749ca4c-7b53-4216-b36a-1a94689768c9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.168997 May 31 18:27:23.434598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 169/330] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:23 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:23.486752 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-4a9c20fa-6fee-48d8-81ce-8b48a1229d4e req-1232f61a-6c3b-4c84-9058-49d416b070fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c2ea84-984c-40c5-8ea9-2909f9340381", "name": "network-vif-plugged", "status": "completed", "tag": "3a257836-88f4-48d7-992d-e63ef214d030"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:27:23.495335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-4a9c20fa-6fee-48d8-81ce-8b48a1229d4e req-1232f61a-6c3b-4c84-9058-49d416b070fc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:23.495723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-4a9c20fa-6fee-48d8-81ce-8b48a1229d4e req-1232f61a-6c3b-4c84-9058-49d416b070fc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:23.508634 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-4a9c20fa-6fee-48d8-81ce-8b48a1229d4e req-1232f61a-6c3b-4c84-9058-49d416b070fc service nova] Creating event network-vif-plugged:3a257836-88f4-48d7-992d-e63ef214d030 for instance 19c2ea84-984c-40c5-8ea9-2909f9340381 on hv-cinder-83979 May 31 18:27:23.513749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-4a9c20fa-6fee-48d8-81ce-8b48a1229d4e req-1232f61a-6c3b-4c84-9058-49d416b070fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030991 May 31 18:27:23.514398 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 162/331] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:27:24.128114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:24.128879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:24.136007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:24.136497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:24.137338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:24.137791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:24.299115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:24.311186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-710b71e6-3b84-45fa-ae1a-3314a8de2e7b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.187582 May 31 18:27:24.311934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 170/332] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:24 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:24.451710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:24.452849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:24.459337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:24.459781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:24.460580 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:24.461014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:24.602975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:24.612052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ccb53879-81ff-4d03-b5ee-f6cf3f436e98 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.164864 May 31 18:27:24.612664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 163/333] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:24 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:25.329023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:25.329639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:25.336375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:25.336833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:25.337615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:25.338054 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:25.472865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:25.480028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1785511a-fd44-4fae-9ef0-cf8394f89d38 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.155003 May 31 18:27:25.480617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 171/334] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:25 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:25.629645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:25.630453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:25.636812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:25.637253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:25.638004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:25.638430 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:25.767322 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:25.774723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bce746a7-61c4-407e-a65c-2fa92797b02b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1313 microversion: 2.1 time: 0.149113 May 31 18:27:25.775286 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 164/335] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:25 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:26.498932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:26.500968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:26.506888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:26.507340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:26.508136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:26.508576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:26.651567 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:26.659526 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8a128c04-a2bf-441c-92c5-a5d526524f17 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.165161 May 31 18:27:26.659939 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 172/336] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:26 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:26.791450 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:26.792134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:26.799109 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:26.799597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:26.800548 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:26.801012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:26.940637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:26.948326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2e9a81d3-01a3-49ed-8adf-754a364758ef tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1497 microversion: 2.1 time: 0.160747 May 31 18:27:26.948988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 165/337] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:26 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:27.679907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:27.680702 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:27.686738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:27.687187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:27.687952 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:27.688447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:27.820391 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:27.829996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ea605ec6-fbf4-4379-a2b3-3cadfe10e89e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.154915 May 31 18:27:27.830788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 173/338] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:27 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:28.565790 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ae23fdf-23e3-4b85-9d04-aa42c4db0286", "device": "/dev/sdb"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:27:28.567350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:28.573919 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:28.574304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:28.575073 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:28.575508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:28.647116 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:28.845024 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d12cbf7b-079a-4b7c-ad78-eb95ba559e0a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "POST /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283478 May 31 18:27:28.845546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 166/339] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:27:28 2022] POST /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:27:28.849795 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:28.851426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:28.860497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:28.861228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:28.863404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:28.864354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:29.005212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:29.012751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f99c146c-e7f5-4cc0-8fd4-8fa6153469c7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.168300 May 31 18:27:29.013321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 174/340] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:28 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:29.700978 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:29.701935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:29.708720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:29.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:29.709932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:29.710369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:29.738505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:27:29.828836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-885f9d44-db7e-4f8a-a9ef-4cc35da7bf2e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "DELETE /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 204 len: 0 microversion: 2.1 time: 0.132828 May 31 18:27:29.829531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 167/341] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:27:29 2022] DELETE /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:27:29.837747 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:29.838350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:29.844904 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:29.845283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:29.846065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:29.846489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:29.979965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:29.988262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b571fabe-2b19-4d7b-aa40-27f67eda28bf tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.154289 May 31 18:27:29.988855 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 175/342] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:29 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:30.030354 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:30.031197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:30.037110 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:30.037595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:30.038355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:30.038790 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:30.174190 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:30.181796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4bf46b8e-a014-4c21-9dfe-242e1ba158a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.155581 May 31 18:27:30.182364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 168/343] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:30 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:31.006945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:31.008262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:31.014522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:31.015137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:31.016028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:31.016490 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:31.147421 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:31.154754 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b717e340-c9c4-4a8c-9ad6-e9d72c3b4df9 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.152419 May 31 18:27:31.156354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 176/344] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:31 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:31.198667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:31.199272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:31.207027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:31.207469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:31.208263 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:31.208695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:31.348183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:31.360905 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-13b58a98-cbe1-437e-a074-110cb2aaf030 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.166000 May 31 18:27:31.361516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 169/345] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:31 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:32.173444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:32.174043 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:32.180025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:32.180499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:32.181259 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:32.181697 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:32.318069 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:32.325353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-43ef92e2-d569-44f9-b965-37a9f1bed415 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.156279 May 31 18:27:32.325906 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 177/346] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:32 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:32.379232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:32.379839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:32.386509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:32.386955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:32.387719 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:32.388208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:32.517775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:32.526078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f2139658-f828-4277-9198-ef6d11d117db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.150570 May 31 18:27:32.526654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 170/347] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:32 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:33.343499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:33.344455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:33.350484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:33.350925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:33.351678 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:33.352134 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:33.482375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:33.490500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4848acd5-a883-451b-bc8f-87532db0f12c tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.151489 May 31 18:27:33.491061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 178/348] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:33 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:33.542593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:33.543126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:33.550968 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:33.551643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:33.552749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:33.553248 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:33.687924 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:33.695712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7918affa-d674-43d0-b083-9914f088a423 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.156974 May 31 18:27:33.698164 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 171/349] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:33 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:34.506945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:34.507561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:34.513566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:34.514014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:34.514780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:34.515304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:34.647150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:34.655480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5945ef4f-73ec-44ea-8593-04d8703ac60b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.151894 May 31 18:27:34.659967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 179/350] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:34 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:34.713402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:34.714038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:34.721360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:34.721803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:34.722556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:34.722982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:34.857202 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:34.865496 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7ded2ba8-2051-4abd-8056-20d06a27ec3e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.155893 May 31 18:27:34.866074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 172/351] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:34 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:35.671720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:35.672513 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:35.678922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:35.679375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:35.680176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:35.680664 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:35.822495 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:35.830762 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-04071b6a-bc3d-4c2c-827e-00a63959edcd tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.163835 May 31 18:27:35.831318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 180/352] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:35 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:35.883040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:35.883659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:35.890753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:35.891200 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:35.892049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:35.892654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:36.047583 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:36.057055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-88f21458-7299-41dc-a44b-9910b5c2cdbc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.177832 May 31 18:27:36.057766 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 173/353] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:35 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:36.854723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:36.855359 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:36.862760 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:36.863298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:36.864376 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:36.864800 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:37.003354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:37.011336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-250a2666-0910-40c0-9028-c9d87e9576e5 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.160746 May 31 18:27:37.011884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 181/354] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:36 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:37.074617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:37.075322 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:37.081936 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:37.082379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:37.083134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:37.083559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:37.229733 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:37.238316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d12db0f9-3286-4af3-bc95-0df248fbf07e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.167522 May 31 18:27:37.238944 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 174/355] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:37 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:38.028599 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:38.030537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:38.041863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:38.046506 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:38.047938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:38.048864 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:38.072403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:38.256320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:38.256932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:38.263539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:38.264989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:38.265774 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:38.266520 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:38.660999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:38.671906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:38.674217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e13b3508-28f1-48b6-8bd1-88125ef2eddb tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1503 microversion: 2.1 time: 0.649616 May 31 18:27:38.679875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b5a12431-b005-45ac-b6f4-4a35d7b516c1 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.427821 May 31 18:27:38.681189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 175/356] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:38 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:38.688620 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 182/357] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:38 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1503 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:38.998998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-c125918b-973f-4884-8b96-b060834f078c req-898efc87-a7d8-40fe-bf42-58925350b9d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19c2ea84-984c-40c5-8ea9-2909f9340381", "name": "network-vif-deleted", "tag": "3a257836-88f4-48d7-992d-e63ef214d030"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:27:39.007946 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-c125918b-973f-4884-8b96-b060834f078c req-898efc87-a7d8-40fe-bf42-58925350b9d1 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:39.008418 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-c125918b-973f-4884-8b96-b060834f078c req-898efc87-a7d8-40fe-bf42-58925350b9d1 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:39.037125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-c125918b-973f-4884-8b96-b060834f078c req-898efc87-a7d8-40fe-bf42-58925350b9d1 service nova] Creating event network-vif-deleted:3a257836-88f4-48d7-992d-e63ef214d030 for instance 19c2ea84-984c-40c5-8ea9-2909f9340381 on hv-cinder-83979 May 31 18:27:39.043287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-c125918b-973f-4884-8b96-b060834f078c req-898efc87-a7d8-40fe-bf42-58925350b9d1 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048872 May 31 18:27:39.044345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 176/358] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:27:39.706235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:39.706931 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:39.708034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:39.708679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:39.714531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:39.714974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:39.715739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:39.716196 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:39.723442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:39.724146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:39.725950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:39.727081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:39.769982 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:39.770769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:39.771852 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lazy-loading 'fault' on Instance uuid 19c2ea84-984c-40c5-8ea9-2909f9340381 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:27:39.838079 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:39.846089 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c94c2262-1ed9-4be1-a3be-12aad79e1038 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1303 microversion: 2.1 time: 0.146712 May 31 18:27:39.846782 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 183/359] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:39 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1303 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:39.900579 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:39.908654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-93b7e569-7e7f-4942-ba83-c92d58aabe63 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.207438 May 31 18:27:39.909243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 177/360] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:39 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:40.864199 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:40.865871 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:40.872342 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:40.872802 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:40.873577 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:40.874012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:40.907223 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:40.907673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:40.908148 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lazy-loading 'fault' on Instance uuid 19c2ea84-984c-40c5-8ea9-2909f9340381 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:27:40.926214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:40.926824 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:40.933231 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:40.933678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:40.934440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:40.934876 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:40.967861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:40.975595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-77d729a3-f88f-41a0-b98a-eabcfc64c65b tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1303 microversion: 2.1 time: 0.116029 May 31 18:27:40.976396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 184/361] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:40 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1303 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:41.178457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:41.191552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-56c3dd1d-438f-4ad0-958f-ec8429560ca4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1500 microversion: 2.1 time: 0.269012 May 31 18:27:41.192633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 178/362] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:40 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1500 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:41.209428 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f771e3e9-e615-49cf-8cbc-9751850bcf02"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:27:41.211063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:41.218765 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:41.219237 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:41.220501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:41.220974 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:41.255969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] HTTP exception thrown: Cannot 'attach_volume' instance abf24b7e-be1e-4235-a568-b5679595a5bd while it is in vm_state rescued May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Request method failure captured: May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/os-volume_attachments HTTP/1.1 May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 74 May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill2DZNbmBXSE1I6kZ6AxRSxP2cDbzLVsV8TkpYhf1AGgVyAxGU-dYUYfqXrWp73VKewLownXsTqqprgnTVpT5bmpXn4Yg3dTHk29KSfNUiXM4CPdusn54OtbSKNMsuyT_sOAhFIBv19P3h78udqSVHQfF5fbnbQNMFtxAlwazeE_U24 May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 2628eee87b7147b8866790922d57222c May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:27:41.259778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2628eee87b7147b8866790922d57222c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2628eee87b7147b8866790922d57222c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 2628eee87b7147b8866790922d57222c May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 39fdc2681def478990bb4b78de5d34ee May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {"volumeAttachment": {"volumeId": "f771e3e9-e615-49cf-8cbc-9751850bcf02"}} May 31 18:27:41.261254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Cannot 'attach_volume' instance abf24b7e-be1e-4235-a568-b5679595a5bd while it is in vm_state rescued May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'server_id': 'abf24b7e-be1e-4235-a568-b5679595a5bd', 'body': {'volumeAttachment': {'volumeId': 'f771e3e9-e615-49cf-8cbc-9751850bcf02'}}} May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance abf24b7e-be1e-4235-a568-b5679595a5bd in vm_state rescued. Cannot attach_volume while the instance is in this state. May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:27:41.262173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance abf24b7e-be1e-4235-a568-b5679595a5bd while it is in vm_state rescued May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:27:41.263809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance abf24b7e-be1e-4235-a568-b5679595a5bd while it is in vm_state rescued May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Returning 409 to user: Cannot 'attach_volume' instance abf24b7e-be1e-4235-a568-b5679595a5bd while it is in vm_state rescued {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-56ef54ee-8364-4f65-b40e-de6a22a33378 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057853 May 31 18:27:41.266614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 185/363] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:27:41 2022] POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 31 18:27:41.275065 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:27:41.275810 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:41.283551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:41.284283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:41.285487 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:41.286203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:41.366139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-51a495f5-7edf-413f-a764-d90201962942 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/action" status: 202 len: 0 microversion: 2.1 time: 0.096112 May 31 18:27:41.366902 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 179/364] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:27:41 2022] POST /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:27:41.378491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:41.379235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:41.388159 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:41.388651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:41.389978 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:41.390544 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:41.549638 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:41.557767 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-67c4844c-3b00-4ecc-b130-b92710d45948 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.186569 May 31 18:27:41.558386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 186/365] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:41 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:41.993523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:41.994439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:42.001258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:42.001822 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:42.002798 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:42.003345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:42.008117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:42.039698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:42.040267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:42.040688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lazy-loading 'fault' on Instance uuid 19c2ea84-984c-40c5-8ea9-2909f9340381 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:27:42.088364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:42.097259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-451c0561-3ef5-4ef9-9569-97b321f6777d tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1303 microversion: 2.1 time: 0.108364 May 31 18:27:42.097818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 180/366] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:41 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1303 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:42.575130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:42.575737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:42.582318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:42.582764 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:42.583519 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:42.583949 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:42.725101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:42.734756 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ed26a1d2-b056-49dd-81b7-f891c2549b70 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.163255 May 31 18:27:42.735326 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 187/367] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:42 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:43.115396 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:43.116026 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:43.122422 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:43.122861 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:43.123855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:43.124469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:43.156972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:43.157411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:43.157856 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lazy-loading 'fault' on Instance uuid 19c2ea84-984c-40c5-8ea9-2909f9340381 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:27:43.199405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:43.207361 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2d175c19-45cd-4c0d-8819-dec0e5b132f2 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1303 microversion: 2.1 time: 0.096231 May 31 18:27:43.208021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 181/368] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:43 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:43.752322 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:43.752927 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:43.760421 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:43.760843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:43.761609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:43.762034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:43.895998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:43.903481 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1a3b4c63-9bca-4015-bf7b-305090d737e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.155047 May 31 18:27:43.904055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 188/369] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:43 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:44.224822 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:44.225445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:44.232537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:44.232991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:44.233983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:44.234792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:44.268324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:44.268778 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:44.269232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lazy-loading 'fault' on Instance uuid 19c2ea84-984c-40c5-8ea9-2909f9340381 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:27:44.309588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '679646d952c94748af853799d5d39cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea31516b7864535b1469752615237f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:44.316377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-743ec3fe-228b-4d80-a32f-4d731027981e tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 200 len: 1303 microversion: 2.1 time: 0.095862 May 31 18:27:44.316946 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 182/370] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:44 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:44.920537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:44.921132 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:44.927011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:44.927453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:44.928234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:44.928664 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:45.057669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:45.065904 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-13fdd086-60c8-498c-9b91-f82394bee6a8 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.149720 May 31 18:27:45.066469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 189/371] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:44 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:45.336283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:45.340055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] [instance: 19c2ea84-984c-40c5-8ea9-2909f9340381] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:45.347199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:45.347996 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:45.355869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:45.355869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:45.365441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] HTTP exception thrown: Instance 19c2ea84-984c-40c5-8ea9-2909f9340381 could not be found. May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Request method failure captured: May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 HTTP/1.1 May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill22-SGMR48Xr7NHeuEwDacY6eayy3jl_-JlS4df279YKRXGxqjYDYlA5riv5P_ddHhMjgBOpLCTm0TcQYIPM0fU-8GF1T9m_9ZCiBOVafH-eEAJLUiPTRqLyE7ISphyGmZi9I5FKKvzeo5-PcLog_Ql4HDVaVuUdALFS5Aef4ArWaU May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 7ea31516b7864535b1469752615237f6 May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesActionsTest-255486724 May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:27:45.368045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea31516b7864535b1469752615237f6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea31516b7864535b1469752615237f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea31516b7864535b1469752615237f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea31516b7864535b1469752615237f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesActionsTest-255486724 May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 7ea31516b7864535b1469752615237f6 May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesActionsTest-255486724 May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesActionsTest-255486724-project May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 679646d952c94748af853799d5d39cc9 May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesActionsTest-255486724-project May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 19c2ea84-984c-40c5-8ea9-2909f9340381 could not be found. May 31 18:27:45.369610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '19c2ea84-984c-40c5-8ea9-2909f9340381'} May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19c2ea84-984c-40c5-8ea9-2909f9340381 could not be found. May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:27:45.370378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19c2ea84-984c-40c5-8ea9-2909f9340381 could not be found. May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19c2ea84-984c-40c5-8ea9-2909f9340381 could not be found. May 31 18:27:45.371537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:27:45.372577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] Returning 404 to user: Instance 19c2ea84-984c-40c5-8ea9-2909f9340381 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:27:45.372577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9084f5bd-f06f-4b86-8d1c-cd5c656292e3 tempest-VolumesActionsTest-255486724 tempest-VolumesActionsTest-255486724-project] 10.222.0.17 "GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381" status: 404 len: 111 microversion: 2.1 time: 0.040051 May 31 18:27:45.372577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 183/372] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:45 2022] GET /compute/v2.1/servers/19c2ea84-984c-40c5-8ea9-2909f9340381 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:27:46.082753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:46.083371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:46.089873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:46.090525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:46.091274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:46.092621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:46.271345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:46.282816 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b076f38b-8df5-48a6-bf4d-ff007f45d986 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.203839 May 31 18:27:46.283792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 190/373] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:46 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:47.300311 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:47.300913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:47.307326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:47.307769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:47.308557 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:47.308973 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:47.444439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:47.452566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-989e0e25-9139-47be-ad60-2490a4dadbac tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.156128 May 31 18:27:47.453123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 184/374] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:47 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:27:48.469914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:48.470526 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:48.472419 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=60 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:48.477708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:48.478155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:48.478921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:48.479387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:48.610988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:48.618430 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-97bb9800-867c-4b82-8264-abd4f804ee6a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.152382 May 31 18:27:48.618970 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 191/375] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:48 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:49.636505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:49.637119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:49.644826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:49.645283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:49.646059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:49.646500 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:49.792463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:49.801183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-790ba5e9-a7a5-48db-9e50-8a22f9a07f79 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.168328 May 31 18:27:49.802173 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 185/376] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:49 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:50.818749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:50.819355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:50.825461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:50.826401 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:50.827219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:50.827647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:50.960128 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:50.968359 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a37ef9be-5b73-4721-9dde-50b477af767f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.153360 May 31 18:27:50.969218 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 192/377] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:50 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:51.985654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:51.986289 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:51.988565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:27:51.993846 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:51.994283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:51.995046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:51.995473 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:52.148374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:52.156322 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a24f1364-9a75-4e4a-9957-e8751fafad99 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.174597 May 31 18:27:52.156889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 186/378] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:51 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:53.173454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:53.174102 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:53.182814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:53.183272 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:53.184074 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:53.184517 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:53.338205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:53.349952 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1231da91-7349-4a8e-8722-d828f1305074 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.180300 May 31 18:27:53.350539 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 193/379] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:53 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:54.366576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:54.367283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:54.374140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:54.374641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:54.375496 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:54.375975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:54.511611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:54.519424 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b82baf33-49f3-48fc-ad00-57ae2b56a0b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.156721 May 31 18:27:54.519984 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 187/380] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:54 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:55.537535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:55.538269 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:55.547147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:55.548318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:55.548993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:55.549549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:55.733431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:55.741430 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3688b8fc-1c0c-4de9-84cc-96153f6c0b22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1508 microversion: 2.1 time: 0.207514 May 31 18:27:55.742115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 194/381] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:55 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:27:56.760433 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:27:56.761027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:27:56.768323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:56.768777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:56.769576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:27:56.770010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:27:56.904898 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:27:56.912451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a9a680c9-bf85-4dd4-85ca-19bb8132662c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1514 microversion: 2.1 time: 0.155883 May 31 18:27:56.913021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 188/382] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:27:56 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:03.770388 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9f0f3f4b-5e30-4ffa-aa2c-10da35c90106 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'create', calling method: .version_select at 0x7ffb74225040>, body: {"keypair": {"name": "tempest-keypair-422438831", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsRMlRi72tf87St754mtlqfOVkR0IF7i6uAn7ZhUrHWRdZ8NjUrXDZxFG1qN9MfhK9lzDCwUZmURLTG87RtIzLn3P8hTTP4CwGPNTUV8bEPv0/Yf8TPkhXv+K8VXVfPdw=="}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:03.787750 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-9f0f3f4b-5e30-4ffa-aa2c-10da35c90106 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for project 2628eee87b7147b8866790922d57222c. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:28:03.792589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-9f0f3f4b-5e30-4ffa-aa2c-10da35c90106 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for user 39fdc2681def478990bb4b78de5d34ee and project 2628eee87b7147b8866790922d57222c. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:28:03.809400 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR oslo.messaging._drivers.impl_rabbit [None req-9f0f3f4b-5e30-4ffa-aa2c-10da35c90106 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [be294827-805e-4d0a-9277-b8b208cb9f39] AMQP server on 10.222.0.17:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 31 18:28:04.826093 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [None req-9f0f3f4b-5e30-4ffa-aa2c-10da35c90106 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [be294827-805e-4d0a-9277-b8b208cb9f39] Reconnected to AMQP server on 10.222.0.17:5672 via [amqp] client with port 57570. May 31 18:28:04.852676 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9f0f3f4b-5e30-4ffa-aa2c-10da35c90106 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.086032 May 31 18:28:04.853275 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 195/383] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:28:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:28:06.657062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1101296010", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cec29bb7-5f55-4916-bcd5-7dcf178908d4"}], "security_groups": [{"name": "tempest-securitygroup--898738748"}], "key_name": "tempest-keypair-422438831", "user_data": "}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:06.781922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] validate_networks() for [('cec29bb7-5f55-4916-bcd5-7dcf178908d4', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:28:06.908813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=55 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:07.207516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:28:07.207925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:28:07.208489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:28:07.208892 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:28:07.209300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:28:07.221265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:07.221708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:07.222526 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:07.222956 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:07.241022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for project 2628eee87b7147b8866790922d57222c. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:28:07.244997 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Getting quotas for user 39fdc2681def478990bb4b78de5d34ee and project 2628eee87b7147b8866790922d57222c. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:28:07.256843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:28:07.259107 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:28:07.308154 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4fc5512c-033b-479d-adba-3c8773e95164 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.655338 May 31 18:28:07.308803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 189/384] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:28:06 2022] POST /compute/v2.1/servers => generated 408 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:28:07.322101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cea05586-7332-40be-9ae6-cd4da3e53c0e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:07.322746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cea05586-7332-40be-9ae6-cd4da3e53c0e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:07.324854 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=77 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:07.393901 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cea05586-7332-40be-9ae6-cd4da3e53c0e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:07.402509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cea05586-7332-40be-9ae6-cd4da3e53c0e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1245 microversion: 2.1 time: 0.084262 May 31 18:28:07.403363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 196/385] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:07 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:08.422277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:08.422855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:08.430209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:08.430658 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:08.431432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:08.431873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:08.496439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:08.504744 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-dfb47359-e7a1-4776-af10-210664bc62a9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1297 microversion: 2.1 time: 0.087270 May 31 18:28:08.505317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 190/386] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:08 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1297 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:09.523592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:09.525649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:09.536624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:09.537417 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:09.538540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:09.539181 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:09.655990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:09.672792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-88f53e98-baf2-4042-9ed1-6c20b0213e1c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1303 microversion: 2.1 time: 0.153254 May 31 18:28:09.673802 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 197/387] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:09 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:10.695408 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:10.696952 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:10.708625 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:10.709885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:10.711580 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:10.712306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:11.081151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:11.090345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b07a78dd-73e0-49a3-b82e-bcb99d4ada22 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.401921 May 31 18:28:11.115947 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 191/388] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:10 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:11.231764 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-f9b5a20c-6469-4267-afae-56fe25932a63 req-5519b160-d368-48f2-9bc8-e62acd497e89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e1c59-1ba0-4754-b95c-49ac8e3cc547", "tag": "301a1ec7-72c4-46e8-b9de-f5e5d1d3e419"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:11.241406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-f9b5a20c-6469-4267-afae-56fe25932a63 req-5519b160-d368-48f2-9bc8-e62acd497e89 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:11.241963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-f9b5a20c-6469-4267-afae-56fe25932a63 req-5519b160-d368-48f2-9bc8-e62acd497e89 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:11.261573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-f9b5a20c-6469-4267-afae-56fe25932a63 req-5519b160-d368-48f2-9bc8-e62acd497e89 service nova] Creating event network-changed:301a1ec7-72c4-46e8-b9de-f5e5d1d3e419 for instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 on hv-cinder-83979 May 31 18:28:11.267813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-f9b5a20c-6469-4267-afae-56fe25932a63 req-5519b160-d368-48f2-9bc8-e62acd497e89 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042449 May 31 18:28:11.268478 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 198/389] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:28:12.132722 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:12.133439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:12.139669 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:12.140156 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:12.140933 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:12.141370 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:12.281932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:12.289521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5c49c0d2-d073-43db-ba95-801185f3c23a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.161264 May 31 18:28:12.290104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 192/390] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:12 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:13.307295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:13.308017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:13.314641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:13.315018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:13.315790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:13.316266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:13.457974 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:13.467390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1be543db-c36d-4532-a2f0-125c656b2d9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.162609 May 31 18:28:13.467991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 199/391] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:13 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:14.123419 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:28:14.123608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:28:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:28:14.486064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:14.487419 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:14.495831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:14.496321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:14.498369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:14.498812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:14.666423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:14.676641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5cd637bb-1ac7-4efc-b45a-eaeebd54f49b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.195553 May 31 18:28:14.677219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 193/392] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:14 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:15.699069 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:15.699069 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:15.706597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:15.707057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:15.707860 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:15.708447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:16.020292 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:16.030683 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-db9f7e59-d16f-4875-ad20-5c742878e081 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.340354 May 31 18:28:16.031358 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 200/393] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:15 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:17.048015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:17.049413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:17.056469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:17.057018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:17.058038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:17.058644 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:17.230509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:17.252796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:17.259008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:17.268646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f8417d17-8895-47f1-a34c-22ecd73e8f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.224877 May 31 18:28:17.278246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 194/394] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:17 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:18.285958 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:18.286585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:18.288802 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=6 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:18.298535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:18.299321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:18.300351 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:18.301274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:18.462501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:18.463106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:18.472998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:18.473448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:18.473570 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:18.474225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:18.474659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:18.482323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1c84c3d2-d98c-46a8-92cd-0b8fd657b8b9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.200080 May 31 18:28:18.484720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 201/395] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:18 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:18.645782 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lazy-loading 'services' on Instance uuid 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:28:18.817105 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ca03d85f-8215-4231-89d3-40ffdd56157f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "DELETE /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7/os-volume_attachments/4ae23fdf-23e3-4b85-9d04-aa42c4db0286" status: 202 len: 0 microversion: 2.1 time: 0.358183 May 31 18:28:18.818317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 195/396] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:28:18 2022] DELETE /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7/os-volume_attachments/4ae23fdf-23e3-4b85-9d04-aa42c4db0286 => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:28:19.493510 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:28:19.494812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Tue May 31 18:28:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:28:19.503610 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:19.505187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:19.520356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:19.524562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:19.525761 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:19.527517 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:19.528879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:19.772002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:19.781794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-746296e0-e7b1-4c38-b68f-3ac4c25026b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.284083 May 31 18:28:19.782356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 202/397] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:19 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:20.804197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:20.805548 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:20.816467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:20.817177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:20.818405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:20.819005 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:20.975144 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:20.988334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b48827a1-2655-4223-867f-285d2e80f9f2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.190395 May 31 18:28:20.999923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 196/398] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:20 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:22.006828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:22.007592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:22.013937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:22.014641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:22.015390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:22.015994 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:22.191456 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:22.200323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f4c36f1c-603d-41eb-9b8e-85bc6bdcc851 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.197503 May 31 18:28:22.201170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 203/399] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:22 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:23.218917 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:23.219880 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:23.222600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:23.231055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:23.231735 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:23.232875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:23.233313 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:23.437484 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:23.445515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f8e1bd92-b35b-44a8-8fe8-518155469ab6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.231594 May 31 18:28:23.453704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 197/400] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:23 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:24.464366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:24.465098 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:24.471556 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:24.472301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:24.473419 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:24.474193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:24.639492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:24.650043 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8f547d24-90ea-482e-825f-9136fda37a4f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.189572 May 31 18:28:24.660212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 204/401] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:24 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:25.672331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:25.674257 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:25.686715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:25.687992 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:25.689910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:25.691174 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:25.873617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:25.883955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1168d139-325d-44c1-a644-b67f410a1c11 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.219318 May 31 18:28:25.885361 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 198/402] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:25 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:26.387968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:26.389164 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:26.398263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:26.398706 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:26.399507 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:26.402389 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:26.445107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:28:26.556783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-44e9d78c-a915-4e1b-a9f1-6588cc8520b8 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "DELETE /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 204 len: 0 microversion: 2.1 time: 0.172822 May 31 18:28:26.560845 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 205/403] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:28:26 2022] DELETE /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 18:28:26.566220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:26.566840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:26.573012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:26.573664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:26.575373 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:26.575809 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:26.761502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:26.770995 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-51873bd7-5dfa-4941-bcb9-3f5a503d670a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.208762 May 31 18:28:26.771841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 199/404] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:26 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:26.904076 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:26.904710 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:26.912214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:26.912661 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:26.913434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:26.913865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:27.110420 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:27.125707 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3842f2cb-444a-448d-9ee0-90e17868997b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.225823 May 31 18:28:27.140480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 206/405] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:26 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:27.791122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:27.792390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:27.800041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:27.800639 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:27.801645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:27.802283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:27.970522 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:27.986226 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-dfefbdd7-3616-4c49-bd4b-a27ab2fef92c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.198914 May 31 18:28:27.987253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 200/406] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:27 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:28.142729 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:28.143314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:28.149952 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:28.150394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:28.151155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:28.151584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:28.318780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:28.327583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ae0ba687-77f2-4c4f-ae05-33aaaf7c1441 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.188654 May 31 18:28:28.328355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 207/407] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:28 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:29.003741 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:29.004616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:29.011217 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:29.012349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:29.013125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:29.013566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:29.153265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:29.160865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ff32c548-d579-4bfd-9478-cb9de74824fd tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.160908 May 31 18:28:29.161434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 201/408] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:28 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:29.344805 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:29.345414 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:29.351324 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:29.351769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:29.352582 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:29.353003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:29.483880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:29.491679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-99859f3c-0cbf-4bde-b4c4-f1fcb8095b81 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.150823 May 31 18:28:29.492284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 208/409] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:29 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:30.180809 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:30.181727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:30.190287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:30.190743 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:30.191525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:30.191967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:30.326775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:30.334423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-36674a7c-857c-4c02-936f-9e2bd12178b1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.159485 May 31 18:28:30.334996 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 202/410] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:30 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:30.509542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:30.510154 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:30.516793 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:30.517241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:30.518020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:30.518459 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:30.658426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:30.666097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-44ce87b9-9b00-43d5-9277-21177e8509b6 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.160239 May 31 18:28:30.666752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 209/411] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:30 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:31.351758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:31.352400 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:31.359361 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:31.359867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:31.360709 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:31.361151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:31.490908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:31.498912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1403907f-ebd8-4434-9453-ac2b3f64b7ce tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.150932 May 31 18:28:31.499472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 203/412] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:31 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:31.684453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:31.685358 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:31.691580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:31.691940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:31.692746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:31.693177 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:31.836376 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:31.844491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2c7c1c69-8d9a-44cb-9c40-ec00f186fbf0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.164650 May 31 18:28:31.845068 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 210/413] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:31 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:32.517215 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:32.517825 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:32.524812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:32.525263 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:32.526021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:32.526454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:32.660977 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:32.669224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8d3fb298-160e-4855-9f25-9f965f02b806 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.155857 May 31 18:28:32.669795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 204/414] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:32 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:32.862795 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:32.863682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:32.869603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:32.870050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:32.870878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:32.871386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:33.005839 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:33.013978 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-df77003c-5c6e-4909-83fe-934d04067d9b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.156022 May 31 18:28:33.014821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 211/415] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:32 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:33.687493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:33.688715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:33.695617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:33.696031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:33.696840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:33.697443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:33.726851 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:33.860124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:33.872297 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-61546a82-7ede-47b0-a90f-bc2aeb4cca45 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.188328 May 31 18:28:33.873037 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 205/416] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:33 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:34.032882 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:34.034544 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:34.047592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:34.047592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:34.048392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:34.057055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:34.087779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:34.242224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:34.252525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-485243dd-12af-4609-9614-391da948d3f7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.224215 May 31 18:28:34.253501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 212/417] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:34 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:34.890712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:34.891253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:34.899233 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:34.899678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:34.900472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:34.900901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:35.039023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:35.046759 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-95f558c5-49de-4a3f-b062-ddd9b75c54f7 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.161397 May 31 18:28:35.047336 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 206/418] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:34 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:35.269701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:35.270302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:35.276284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:35.276730 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:35.277795 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:35.278232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:35.414022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:35.423562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-50259d9c-514f-4848-8cc1-595e665d394d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.157773 May 31 18:28:35.424140 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 213/419] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:35 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:36.064110 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:36.064738 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:36.071251 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:36.071723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:36.072525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:36.072965 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:36.237957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:36.247808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-17ef5372-7442-4c98-a9a7-40607e2a37f1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.187570 May 31 18:28:36.248952 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 207/420] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:36 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:36.440544 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:36.441261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:36.447485 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:36.448029 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:36.449587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:36.450165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:36.596631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:36.606743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a5b12054-3c8e-44a6-813e-8431f5183be7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.169962 May 31 18:28:36.608330 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 214/421] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:36 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:37.269987 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:37.270616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:37.278106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:37.278578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:37.279369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:37.279802 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:37.440763 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:37.450211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e2594e53-37ab-4a32-9595-d9084424b002 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1514 microversion: 2.1 time: 0.184873 May 31 18:28:37.451240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 208/422] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:37 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:37.624082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:37.624720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:37.630938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:37.631381 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:37.632255 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:37.633223 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:37.784564 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:37.792332 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c8d72362-9626-4759-8512-d2cfd232c87a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.172754 May 31 18:28:37.793457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 215/423] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:37 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:38.323284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-743210fa-721c-412f-b8cf-466c12e3cccd req-1a1d3f61-fbab-4a88-9a8e-42c4b76315d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31b0a74e-7d2a-4cde-878d-ecf37360b6e7", "name": "network-vif-deleted", "tag": "b7992847-af7b-4732-b099-891ac841b342"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:38.335236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-743210fa-721c-412f-b8cf-466c12e3cccd req-1a1d3f61-fbab-4a88-9a8e-42c4b76315d7 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:38.335876 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-743210fa-721c-412f-b8cf-466c12e3cccd req-1a1d3f61-fbab-4a88-9a8e-42c4b76315d7 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:38.349199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-743210fa-721c-412f-b8cf-466c12e3cccd req-1a1d3f61-fbab-4a88-9a8e-42c4b76315d7 service nova] Creating event network-vif-deleted:b7992847-af7b-4732-b099-891ac841b342 for instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 on hv-cinder-83979 May 31 18:28:38.354185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-743210fa-721c-412f-b8cf-466c12e3cccd req-1a1d3f61-fbab-4a88-9a8e-42c4b76315d7 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035215 May 31 18:28:38.355426 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 209/424] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:28:38.467462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:38.468138 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:38.474151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:38.474595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:38.475353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:38.475797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:38.513285 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:38.513753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:38.514248 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lazy-loading 'fault' on Instance uuid 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:28:38.559440 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:38.567150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-00a969e1-cd23-42d9-bc61-5aaf45ec3853 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 200 len: 1309 microversion: 2.1 time: 0.104178 May 31 18:28:38.568111 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 216/425] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:38 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:38.810170 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:38.810983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:38.818966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:38.819416 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:38.820212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:38.820650 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:38.984574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:39.001194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-20ce8caf-1f67-4ce3-ada5-091bbbdac7ba tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.195016 May 31 18:28:39.001683 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 210/426] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:38 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:28:39.585468 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:39.586106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 31b0a74e-7d2a-4cde-878d-ecf37360b6e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:39.592565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:39.593002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:39.593785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:39.594214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:39.609336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] HTTP exception thrown: Instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 could not be found. May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Request method failure captured: May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 HTTP/1.1 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill26msA4wpcfUKW6wD3XagNNp4MzzZHbOevkbtDhr-UVUnSuZdABt9qHo2TcMhEZDhnBYtCOhVpiyjfSDUQg_3zpwQf67g-GBHatJFzbfcfpT25li6a1PfwGwoGq4J4urpJSTGAxRaW3CBJdELwm8E0JEuLxu98OOPXE3UBbB3Spby0 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: d08b32a2616b44f9b4cdcb0bdb898044 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-889051698 May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:28:39.610963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesSnapshotTestJSON-889051698 May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: d08b32a2616b44f9b4cdcb0bdb898044 May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-889051698 May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesSnapshotTestJSON-889051698-project May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: efaf39eaa1f24350b03960716b5d837e May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesSnapshotTestJSON-889051698-project May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 could not be found. May 31 18:28:39.612511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '31b0a74e-7d2a-4cde-878d-ecf37360b6e7'} May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 could not be found. May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:28:39.613385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 could not be found. May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 could not be found. May 31 18:28:39.614811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:28:39.616056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Returning 404 to user: Instance 31b0a74e-7d2a-4cde-878d-ecf37360b6e7 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:28:39.616056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5430c78d-a560-498e-bfe5-65f4b70f7a4c tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7" status: 404 len: 111 microversion: 2.1 time: 0.030786 May 31 18:28:39.616056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 217/427] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:39 2022] GET /compute/v2.1/servers/31b0a74e-7d2a-4cde-878d-ecf37360b6e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:28:40.018518 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:40.019149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:40.025796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:40.026244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:40.028233 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:40.028677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:40.161311 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:40.169436 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-eeac327c-7564-4b82-b2bf-656af5fc2440 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.155205 May 31 18:28:40.169996 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 211/428] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:40 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:41.187517 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:41.188049 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:41.194363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:41.194804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:41.195565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:41.195995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:41.330237 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:41.339508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6bdf407a-faea-45eb-86ff-6ae4d7d42d78 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.156628 May 31 18:28:41.340197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 218/429] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:41 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:42.356487 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:42.357105 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:42.363244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:42.363695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:42.364577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:42.365016 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:42.497236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:42.505313 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-382c4df0-6304-4b24-a7b2-8cb20613de55 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.152884 May 31 18:28:42.505877 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 212/430] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:42 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:43.523003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:43.523664 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:43.530690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:43.531136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:43.531910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:43.532382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:43.666005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:43.673657 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6f5b232b-64aa-4a8e-9aeb-940ad5ff1c21 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.154481 May 31 18:28:43.674264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 219/431] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:43 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:44.697480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:44.698086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:44.704655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:44.705097 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:44.705849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:44.706276 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:44.840076 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:44.847468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-932026da-bfd8-483c-90be-37428411f492 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.153770 May 31 18:28:44.848056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 213/432] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:44 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:45.864941 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:45.865561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:45.871857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:45.872338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:45.873145 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:45.873574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:46.008022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:46.015533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-93188a1d-6b18-4636-81f3-b966f46f9df5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.154386 May 31 18:28:46.016106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 220/433] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:45 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:47.048701 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:47.050367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:47.064879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:47.066796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:47.067677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:47.068033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:47.080678 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-36b5b448-1ac9-4d20-be1b-874b17f6de31 req-f364174d-a72c-4a9d-882f-561bc46981c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e1c59-1ba0-4754-b95c-49ac8e3cc547", "name": "network-vif-plugged", "status": "completed", "tag": "301a1ec7-72c4-46e8-b9de-f5e5d1d3e419"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:47.107034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-36b5b448-1ac9-4d20-be1b-874b17f6de31 req-f364174d-a72c-4a9d-882f-561bc46981c4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:47.110986 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-36b5b448-1ac9-4d20-be1b-874b17f6de31 req-f364174d-a72c-4a9d-882f-561bc46981c4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:47.137121 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-36b5b448-1ac9-4d20-be1b-874b17f6de31 req-f364174d-a72c-4a9d-882f-561bc46981c4 service nova] Creating event network-vif-plugged:301a1ec7-72c4-46e8-b9de-f5e5d1d3e419 for instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 on hv-cinder-83979 May 31 18:28:47.152139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-36b5b448-1ac9-4d20-be1b-874b17f6de31 req-f364174d-a72c-4a9d-882f-561bc46981c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094192 May 31 18:28:47.152814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 221/434] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:28:47.265090 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:47.273051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cd6bb7a8-a2b1-44e9-8454-b66cf3f8c003 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.233491 May 31 18:28:47.273760 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 214/435] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:47 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:48.295258 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:48.296057 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:48.302461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:48.302912 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:48.303683 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:48.304143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:48.453538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:48.464493 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c6704f85-8505-4fdc-b142-facb4ae5dd16 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.174187 May 31 18:28:48.465397 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 222/436] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:48 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:49.482778 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:49.483555 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:49.492528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:49.492981 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:49.493759 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:49.494205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:49.669067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:49.677267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d5f267e6-533c-46e7-987b-a005a44ceb24 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1370 microversion: 2.1 time: 0.199281 May 31 18:28:49.678340 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 215/437] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:49 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:50.694561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:50.695181 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:50.697217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:50.702852 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:50.703298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:50.704063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:50.704516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:50.836442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:50.844599 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d46ac554-a903-49b3-b50a-c1c87cc6c544 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1562 microversion: 2.1 time: 0.153819 May 31 18:28:50.845155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 223/438] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:50 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:50.861112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:50.861635 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:50.867967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:50.868460 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:50.869226 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:50.869666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:50.951786 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0ffbbbaa-d26d-448f-84eb-1e133a5fc6aa tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094295 May 31 18:28:50.952727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 216/439] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:28:50 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:28:52.199143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-0a59b2cd-883a-45e3-9846-d75b48926682 req-baea8279-17e3-46a4-b353-1af1b0e6547d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e1c59-1ba0-4754-b95c-49ac8e3cc547", "tag": "301a1ec7-72c4-46e8-b9de-f5e5d1d3e419"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:52.207645 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-0a59b2cd-883a-45e3-9846-d75b48926682 req-baea8279-17e3-46a4-b353-1af1b0e6547d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:52.208108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-0a59b2cd-883a-45e3-9846-d75b48926682 req-baea8279-17e3-46a4-b353-1af1b0e6547d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:52.221235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-0a59b2cd-883a-45e3-9846-d75b48926682 req-baea8279-17e3-46a4-b353-1af1b0e6547d service nova] Creating event network-changed:301a1ec7-72c4-46e8-b9de-f5e5d1d3e419 for instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 on hv-cinder-83979 May 31 18:28:52.227571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-0a59b2cd-883a-45e3-9846-d75b48926682 req-baea8279-17e3-46a4-b353-1af1b0e6547d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032139 May 31 18:28:52.228217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 224/440] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:28:53.833999 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-624356583", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "networks": [{"uuid": "77ec8a5b-182f-4f0c-96ec-b9e1b64385e5"}]}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:28:53.843785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=40 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:28:53.897259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] validate_networks() for [('77ec8a5b-182f-4f0c-96ec-b9e1b64385e5', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:28:54.341776 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:28:54.342261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:28:54.342780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:28:54.343298 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:28:54.343764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:28:54.353318 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:54.353787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:54.355261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:54.355783 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:54.375278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Getting quotas for project d08b32a2616b44f9b4cdcb0bdb898044. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:28:54.379728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Getting quotas for user efaf39eaa1f24350b03960716b5d837e and project d08b32a2616b44f9b4cdcb0bdb898044. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:28:54.391691 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:28:54.394066 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:28:54.442258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-684b4662-2257-4e3e-a639-e74fcd172483 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612470 May 31 18:28:54.449091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 217/441] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:28:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:28:54.456409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e76a40d1-42fc-4c9c-b33d-606be8e56055 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:54.457261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e76a40d1-42fc-4c9c-b33d-606be8e56055 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:54.523216 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e76a40d1-42fc-4c9c-b33d-606be8e56055 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:54.531094 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e76a40d1-42fc-4c9c-b33d-606be8e56055 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1218 microversion: 2.1 time: 0.080368 May 31 18:28:54.540763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 225/442] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:54 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:55.548613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:55.549261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:55.559182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:55.559627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:55.560430 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:55.560925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:55.652140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:55.661847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8dee1070-7a22-4adf-8356-e5fffe1e06d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1278 microversion: 2.1 time: 0.116993 May 31 18:28:55.662809 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 218/443] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:55 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1278 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:56.681168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:56.681892 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:56.688370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:56.688818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:56.689584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:56.690068 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:56.826954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:56.834708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c083543f-81c2-475c-a4a2-d39f99f9542a tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.158505 May 31 18:28:56.835286 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 226/444] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:56 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:57.852326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:57.852966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:57.860237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:57.860685 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:57.861442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:57.861876 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:57.995914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:58.003480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-64eb5e1c-170b-4d76-9dd5-916bdb964303 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.155099 May 31 18:28:58.004336 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 219/445] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:57 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:28:59.020803 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:28:59.021418 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:28:59.028372 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:59.028823 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:59.029591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:28:59.030028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:28:59.165275 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:28:59.173280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3dfe6f2c-a7c9-4a0a-8651-4b879c09ba6d tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.156301 May 31 18:28:59.173835 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 227/446] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:28:59 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:00.190414 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:00.191807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:00.199350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:00.199873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:00.200688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:00.201157 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:00.569432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:00.577750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2b65221f-c889-449f-a8b0-3c8ac28ed1c5 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.391266 May 31 18:29:00.578329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 220/447] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:00 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:00.680234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-52a97eba-a53f-46c3-b3d2-bf5e12b72293 req-178b2b11-c658-426c-8cdd-a4f0908a9988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41810a2c-bfad-475c-93a8-1c3a3849fa15", "tag": "6b042e87-8779-4fdb-b82b-8fc9b4eca334"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:00.689670 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-52a97eba-a53f-46c3-b3d2-bf5e12b72293 req-178b2b11-c658-426c-8cdd-a4f0908a9988 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:00.690283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-52a97eba-a53f-46c3-b3d2-bf5e12b72293 req-178b2b11-c658-426c-8cdd-a4f0908a9988 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:00.703288 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-52a97eba-a53f-46c3-b3d2-bf5e12b72293 req-178b2b11-c658-426c-8cdd-a4f0908a9988 service nova] Creating event network-changed:6b042e87-8779-4fdb-b82b-8fc9b4eca334 for instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 on hv-cinder-83979 May 31 18:29:00.708110 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-52a97eba-a53f-46c3-b3d2-bf5e12b72293 req-178b2b11-c658-426c-8cdd-a4f0908a9988 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031636 May 31 18:29:00.708712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 228/448] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:29:01.596220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:01.597679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:01.606303 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:01.607713 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:01.608689 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:01.609341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:01.945666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:01.957887 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cbc6fa33-6490-47d1-b876-c3bd965ff0f9 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.365928 May 31 18:29:01.958718 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 221/449] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:01 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:29:02.976056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:02.976775 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:02.984112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:02.984637 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:02.985520 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:02.986028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:03.146749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:03.156465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2a23a24f-b854-4bdc-9f05-76d1272ab78f tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.184516 May 31 18:29:03.157672 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 229/450] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:02 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:04.174527 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:04.175093 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:04.181447 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:04.181976 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:04.182735 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:04.183387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:04.185905 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=89 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:04.324012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:04.331486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f1d38ff4-53df-42f6-bbcf-308309085e3b tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.160762 May 31 18:29:04.332062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 222/451] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:04 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:05.349749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:05.350362 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:05.352297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:05.357728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:05.358178 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:05.358945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:05.359384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:05.363467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=85 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:05.492819 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:05.501564 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-67ba77dd-9d4d-41c2-a2f2-917fdbbe1df3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.155596 May 31 18:29:05.502342 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 230/452] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:05 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:06.523940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:06.523940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:06.523940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:06.525480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:06.534843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:06.535800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:06.536063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:06.536524 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:06.674708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:06.685655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-30499a88-8f29-460f-8906-ba3b17d7adc3 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.170463 May 31 18:29:06.686218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 223/453] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:06 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:07.703513 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:07.704047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:07.710171 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:07.710622 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:07.711401 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:07.711837 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:07.876037 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:07.892356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-784b377e-5def-4bbc-a7da-2bd6405fa4bf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.192733 May 31 18:29:07.893027 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 231/454] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:07 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:07.998788 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-fad4fb8b-e459-43d2-9fd3-a98054cedd6d req-ca87bc8a-ebd9-4071-9d38-e38cdfdaeaa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41810a2c-bfad-475c-93a8-1c3a3849fa15", "name": "network-vif-plugged", "status": "completed", "tag": "6b042e87-8779-4fdb-b82b-8fc9b4eca334"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:08.018342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fad4fb8b-e459-43d2-9fd3-a98054cedd6d req-ca87bc8a-ebd9-4071-9d38-e38cdfdaeaa2 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:08.019405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fad4fb8b-e459-43d2-9fd3-a98054cedd6d req-ca87bc8a-ebd9-4071-9d38-e38cdfdaeaa2 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:08.047260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-fad4fb8b-e459-43d2-9fd3-a98054cedd6d req-ca87bc8a-ebd9-4071-9d38-e38cdfdaeaa2 service nova] Creating event network-vif-plugged:6b042e87-8779-4fdb-b82b-8fc9b4eca334 for instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 on hv-cinder-83979 May 31 18:29:08.053866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-fad4fb8b-e459-43d2-9fd3-a98054cedd6d req-ca87bc8a-ebd9-4071-9d38-e38cdfdaeaa2 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059306 May 31 18:29:08.054733 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 224/455] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:08.917277 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:08.918050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:08.925187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:08.925740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:08.926781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:08.927430 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:09.077550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:09.085429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0c01726c-6cb1-465c-b366-fc4f61435c27 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.172202 May 31 18:29:09.086021 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 232/456] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:08 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:10.105768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:10.106541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:10.114552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:10.115074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:10.115793 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:10.116276 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:10.255277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:10.263135 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-38196dd4-1230-41f4-8b37-507276645adf tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1318 microversion: 2.1 time: 0.162854 May 31 18:29:10.263710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 225/457] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:10 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:11.281636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:11.282252 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:11.288326 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:11.288773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:11.289563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:11.289994 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:11.429987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:11.438038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4e562e96-ea66-4d3c-9674-ac96314cbace tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1506 microversion: 2.1 time: 0.160269 May 31 18:29:11.438602 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 233/458] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:11 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:11.455218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29eb2058-a633-442e-bf98-e2430c1f6e12", "device": "/dev/sdb"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:11.456267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:11.464484 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:11.464932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:11.465700 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:11.466131 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:11.759369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9ce92dce-1d52-4cab-bdd1-75a36fe2d1b6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "POST /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308270 May 31 18:29:11.761031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 226/459] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:29:11 2022] POST /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:14.991366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:14.993309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:15.003992 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:15.004562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:15.005345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:15.005827 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:15.189682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-966e8840-61c8-4369-91f4-112610205a99 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action" status: 200 len: 29253 microversion: 2.1 time: 0.202895 May 31 18:29:15.190316 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 234/460] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:29:14 2022] POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action => generated 29253 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:29:23.874132 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:23.874894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:23.880214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:23.881210 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:23.889869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:23.890312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:23.891079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:23.891489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:26.188570 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:26.189122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:26.191850 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=25 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:26.192559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=27 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:26.199573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:26.200064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:26.200932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:26.201374 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:26.226084 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-130a0d13-e4e0-4187-a423-27faa4241cf0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/ips" status: 200 len: 146 microversion: 2.1 time: 0.042443 May 31 18:29:26.226653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 235/461] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:29:26 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/ips => generated 146 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:29:29.648422 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b1dfbd57-cf57-4982-a800-bd6899bd5afa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/action" status: 200 len: 39408 microversion: 2.1 time: 5.775507 May 31 18:29:29.649616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 227/462] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:29:23 2022] POST /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/action => generated 39408 bytes in 5778 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:29:29.790716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:29.791296 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:29.797850 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:29.798302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:29.799078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:29.799518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:29.823489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-65db17bf-f641-4c5e-8bab-508f67123ec7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/ips" status: 200 len: 148 microversion: 2.1 time: 0.036744 May 31 18:29:29.824740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 236/463] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:29:29 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:33.334720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c633c5-05c7-49af-b743-59775b73b475"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:33.334720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:33.339805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:33.340337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:33.341290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:33.341725 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:37.719863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-649b2d5a-23fb-434f-b36d-05d795091962 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.396468 May 31 18:29:37.720550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 228/464] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:29:33 2022] POST /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments => generated 194 bytes in 4398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:39.831028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31993f59-2389-4210-91f4-6bdfc8d6789b"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:39.832196 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:39.834542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=4 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:39.835173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=8 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:39.842899 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:39.843344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:39.844115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:39.844545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:40.161414 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a9b9e20a-3100-4579-aea7-c3108a33496f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334125 May 31 18:29:40.162032 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 237/465] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:29:39 2022] POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:43.533776 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:43.538090 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:43.538667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:43.545076 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:43.545580 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:43.546277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:43.546715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:43.638391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lazy-loading 'services' on Instance uuid 41810a2c-bfad-475c-93a8-1c3a3849fa15 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:29:43.713445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1988d82d-3367-44df-93b3-5560f83bf077 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15/os-volume_attachments/29eb2058-a633-442e-bf98-e2430c1f6e12" status: 202 len: 0 microversion: 2.1 time: 0.180652 May 31 18:29:43.714046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 229/466] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:29:43 2022] DELETE /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15/os-volume_attachments/29eb2058-a633-442e-bf98-e2430c1f6e12 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:29:48.414987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b62031e3-b65a-4be3-bbaa-786a126b1564 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: .version_select at 0x7ffb74225d30>, body: {"keypair": {"name": "tempest-keypair-1483441887", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOThQcJSAhuPxKtdFK5F0izdDHpoxmTmh2ChFqJzC/+5vEGCG4PoXYNsrHFMut+Amc/jFxoGqU/v8NuhBx8nWiU+vQbN3wQmZzxldCGzTb7WLsUttBI3P99RQ4I2Ptt6aQ=="}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:48.429362 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-b62031e3-b65a-4be3-bbaa-786a126b1564 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:29:48.433737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-b62031e3-b65a-4be3-bbaa-786a126b1564 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:29:48.456357 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b62031e3-b65a-4be3-bbaa-786a126b1564 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045506 May 31 18:29:48.456938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 238/467] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:29:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:49.839988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-177873699", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "900f31eb-512c-4a14-a74f-282a3e50261b"}], "security_groups": [{"name": "tempest-securitygroup--1036881281"}], "key_name": "tempest-keypair-1483441887", "user_data": "}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:49.965237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] validate_networks() for [('900f31eb-512c-4a14-a74f-282a3e50261b', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:29:50.399643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:29:50.400063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:29:50.400597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:29:50.401631 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:29:50.402044 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:29:50.410965 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:50.411402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:50.412208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:50.412636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:50.429528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:29:50.433534 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:29:50.444306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:29:50.446654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:29:50.493581 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4b1c34ec-8faa-4223-a490-e73f145a87e4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.659144 May 31 18:29:50.494221 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 230/468] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:29:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:29:50.501617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:50.505833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-24a458eb-a1ed-47cb-8618-8087d3f1a443 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:50.506535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-24a458eb-a1ed-47cb-8618-8087d3f1a443 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:50.767755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-24a458eb-a1ed-47cb-8618-8087d3f1a443 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:50.777256 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-24a458eb-a1ed-47cb-8618-8087d3f1a443 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1241 microversion: 2.1 time: 0.275600 May 31 18:29:50.777833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 239/469] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:50 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1241 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:51.795437 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:51.796051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:51.803051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:51.803496 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:51.804371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:51.804852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:51.948167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:51.955817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1e43380b-589d-4129-8a3e-aa38a6ec1e81 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1299 microversion: 2.1 time: 0.165403 May 31 18:29:51.956424 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 231/470] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:51 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:52.974135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:52.974685 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:52.983045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:52.983997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:52.984815 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:52.985250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:53.204584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:53.211940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-03d0ecae-6b55-41ac-8202-c2defb5842b7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.241847 May 31 18:29:53.212514 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 240/471] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:52 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:53.281189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-de9f7842-0a45-417b-9279-51d16d91778c req-352f67cb-1d60-4e7d-b55c-20cbcdb3e63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635bcc80-e6b1-4b95-aefb-4aa155a59f4e", "tag": "0a09d26b-1e9d-4f38-a3ee-457e3ceb3332"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:53.292433 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-de9f7842-0a45-417b-9279-51d16d91778c req-352f67cb-1d60-4e7d-b55c-20cbcdb3e63f service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:53.293676 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-de9f7842-0a45-417b-9279-51d16d91778c req-352f67cb-1d60-4e7d-b55c-20cbcdb3e63f service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:53.305055 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-de9f7842-0a45-417b-9279-51d16d91778c req-352f67cb-1d60-4e7d-b55c-20cbcdb3e63f service nova] Creating event network-changed:0a09d26b-1e9d-4f38-a3ee-457e3ceb3332 for instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e on hv-cinder-83979 May 31 18:29:53.310687 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-de9f7842-0a45-417b-9279-51d16d91778c req-352f67cb-1d60-4e7d-b55c-20cbcdb3e63f service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034056 May 31 18:29:53.311538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 232/472] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:29:54.230512 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:54.231139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:54.237985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:54.238301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:54.239083 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:54.239543 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:54.379625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:54.388438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-176a185c-1d8c-4581-a1df-8c5eabe371ad tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.163656 May 31 18:29:54.388990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 241/473] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:54 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:55.097360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b3fdc31c-a885-4aaa-a03f-658e48e8d72a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:29:55.103717 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b3fdc31c-a885-4aaa-a03f-658e48e8d72a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:55.104217 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b3fdc31c-a885-4aaa-a03f-658e48e8d72a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:55.135683 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:29:55.174747 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b3fdc31c-a885-4aaa-a03f-658e48e8d72a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Going to try to stop instance {{(pid=117590) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 18:29:55.233406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b3fdc31c-a885-4aaa-a03f-658e48e8d72a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action" status: 202 len: 0 microversion: 2.1 time: 0.140787 May 31 18:29:55.234007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 233/474] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:29:55 2022] POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:29:55.242141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:55.242753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:55.249226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:55.249669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:55.250438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:55.250873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:55.397309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:55.406638 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2ecfa708-0bd0-45f9-92b7-8e2f9be4beaa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.168256 May 31 18:29:55.408360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:55.409256 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:55.410951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 242/475] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:55 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:55.417054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:55.417598 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:55.418521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:55.419263 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:55.580771 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:55.589637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d0b0834b-56b3-4779-b631-850f7d851e30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.186553 May 31 18:29:55.590458 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 234/476] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:55 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:29:56.425662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:56.426269 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:56.432948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:56.433429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:56.434235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:56.434668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:56.572040 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:56.580820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b2d2646c-5aae-4911-9be2-e55216e208f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.159050 May 31 18:29:56.581370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 243/477] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:56 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:56.607700 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:56.608308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:56.614624 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:56.615064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:56.615812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:56.616284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:56.763063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:56.772407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1050dccd-d12e-4cbd-9c21-284b3c7620bc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.168611 May 31 18:29:56.773356 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 235/478] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:56 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:29:57.598352 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:57.598890 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:57.605851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:57.606618 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:57.607692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:57.608502 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:57.738781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:57.747451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-31d0bb89-f1be-4d96-a87b-2238040a3685 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.153017 May 31 18:29:57.748013 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 244/479] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:57 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:57.790054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:57.790667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:57.798115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:57.798590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:57.799420 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:57.799857 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:57.953291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:57.961072 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bbccb806-863f-43cd-b8ce-3d829382285c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.174808 May 31 18:29:57.961647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 236/480] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:57 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:58.765168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:58.765781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:58.772347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:58.772799 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:58.773566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:58.774005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:58.908954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:58.916809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-68e71579-3fa8-415f-a8b8-3f21a961a647 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.155499 May 31 18:29:58.917365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 245/481] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:58 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:29:58.979127 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:29:58.979734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:29:58.986111 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:58.986557 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:58.987316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:29:58.987749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:29:59.116745 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:29:59.124762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3deb8d27-fd16-4b17-b82b-724c35d0cc26 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.150056 May 31 18:29:59.125341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 237/482] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:58 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:00.042244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:00.042863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:00.048939 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:00.049388 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:00.050151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:00.050586 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:00.206299 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:00.207842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:00.208993 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:00.216589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-159c894a-482d-427f-9699-acf9fcd653db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.286180 May 31 18:30:00.217174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 246/483] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:29:59 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:00.218772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:00.219437 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:00.220740 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:00.221498 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:00.366777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:00.375551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-be16d60e-20b9-4368-a9fe-6cf1e07d0c17 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.237208 May 31 18:30:00.376184 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 238/484] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:00 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:01.234392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:01.235027 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:01.236924 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=6 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:01.242728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:01.243172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:01.243990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:01.245082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:01.385759 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:01.394203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:01.394829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:01.395325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8fd1b28f-a2c0-4ef6-aa71-4c400b509885 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.164531 May 31 18:30:01.395909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 247/485] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:01 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:01.396816 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:01.397641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:01.402991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:01.403437 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:01.404237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:01.404678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:01.776428 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:01.783942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-964ab75d-1fd0-403f-9630-428f13061aab tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.393442 May 31 18:30:01.784539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 239/486] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:01 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:02.412257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:02.412786 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:02.419643 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:02.420097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:02.420874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:02.421302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:02.562773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:02.571004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-baabb58b-6af6-4976-8078-2e2fbbeac855 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.162703 May 31 18:30:02.571563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 248/487] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:02 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:02.801610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:02.802229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:02.809058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:02.809510 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:02.810292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:02.810728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:02.960075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:02.968338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7b46a7bd-4abb-4b31-852f-70741dfec709 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.170534 May 31 18:30:02.968914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 240/488] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:02 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:03.589756 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:03.590369 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:03.596906 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:03.597356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:03.598132 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:03.598570 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:03.735817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:03.743738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-514d97f0-c6ff-4e09-9f66-b37a5db805ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.158545 May 31 18:30:03.744849 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 249/489] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:03 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:03.985305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:03.985913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:03.992302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:03.992749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:03.993508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:03.994668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:04.128452 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:04.136346 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a248c504-e2c0-4ee3-b6c7-352860dc1a0d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.154844 May 31 18:30:04.136908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 241/490] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:03 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:04.764492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:04.765424 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:04.773104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:04.773549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:04.774313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:04.774739 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:04.912397 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:04.921637 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-98072641-4735-4f92-8765-72082f30a21d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.163493 May 31 18:30:04.922222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 250/491] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:04 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:05.153956 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:05.154493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:05.161279 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:05.161747 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:05.162523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:05.162959 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:05.309810 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:05.317468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b29d425b-8bd6-4719-8b9a-0eda13daf7fd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.168130 May 31 18:30:05.318036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 242/492] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:05 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:05.938947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:05.939466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:05.945896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:05.946337 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:05.948204 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:05.948650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:06.080241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:06.088930 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-792c2cd5-b6ac-4202-8edb-481f7f119109 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.153855 May 31 18:30:06.089496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 251/493] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:05 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:06.335126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:06.335717 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:06.342904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:06.343349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:06.344144 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:06.344582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:06.476036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:06.484501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-17b0a18f-f927-4415-ab64-fbe75518c46f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.153227 May 31 18:30:06.485061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 243/494] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:06 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:07.106157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:07.106767 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:07.113436 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:07.113952 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:07.114801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:07.115238 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:07.250473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:07.258905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-79cac96e-98ef-499b-a04d-938eacb2f5fd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.156899 May 31 18:30:07.259530 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 252/495] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:07 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:07.502386 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:07.503280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:07.510057 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:07.510500 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:07.511260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:07.511693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:07.639439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:07.646817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-58bdf977-9e98-4a1c-9be0-af8d532be74d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.148314 May 31 18:30:07.647378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 244/496] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:07 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:08.276771 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:08.277385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:08.284077 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:08.284557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:08.285344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:08.285785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:08.427537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:08.435735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6d866fc5-6293-49c5-9638-0050cf1a4604 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.163039 May 31 18:30:08.436326 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 253/497] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:08 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:08.664297 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:08.664839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:08.672494 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:08.672943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:08.673706 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:08.674129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:08.806533 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:08.814132 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f8ec32f5-9cab-4beb-b037-7720f90c7431 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.153825 May 31 18:30:08.814710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 245/498] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:08 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:09.452862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:09.453412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:09.459873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:09.460352 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:09.461114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:09.461553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:09.591623 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:09.599465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-654f5d6b-3d69-46cb-8fc1-6b8dc12c5f90 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.150468 May 31 18:30:09.600022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 254/499] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:09 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:09.830881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:09.831529 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:09.838545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:09.839086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:09.839841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:09.840299 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:09.974041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:09.981915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-53978901-f46b-4a50-b66b-44e803813360 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.154900 May 31 18:30:09.982488 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 246/500] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:09 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:10.617347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:10.617963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:10.620329 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:10.625926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:10.626405 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:10.627183 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:10.627876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:10.776352 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:10.786457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-dbc570d2-b0a6-4620-9798-83fed6121ecc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.172937 May 31 18:30:10.787095 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 255/501] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:10 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:10.999016 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:10.999640 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:11.006764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:11.007211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:11.007994 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:11.008558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:11.151434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:11.159366 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-515c4a2b-02f5-46df-ab76-b8e94077293f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.164141 May 31 18:30:11.159950 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 247/502] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:10 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:11.803828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:11.804443 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:11.811733 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:11.812214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:11.813172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:11.813571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:11.836041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:11.957362 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:11.966554 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-27182fe1-36b3-4037-a2f7-7c67c13dbbdc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.166492 May 31 18:30:11.967123 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 256/503] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:11 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:12.177083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:12.177637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:12.185818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:12.186255 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:12.187036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:12.187461 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:12.334002 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:12.336498 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:12.345255 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3e1af08d-71f2-4d06-984b-6b86b61cec84 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.172147 May 31 18:30:12.346123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 248/504] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:12 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:12.984313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:12.984970 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:12.993647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:12.994188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:12.994964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:12.995408 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:13.132892 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:13.141613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ca5ee796-5345-4d4a-bc24-4b1114cd8705 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.161040 May 31 18:30:13.142196 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 257/505] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:12 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:13.363079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:13.363777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:13.372510 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:13.373031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:13.373753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:13.374197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:13.512606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:13.520121 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0c0a6319-d5fe-4183-af54-7f2623016d65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.161458 May 31 18:30:13.520708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 249/506] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:13 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:14.158807 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:14.159458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:14.166356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:14.166807 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:14.167592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:14.168033 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:14.403396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:14.411498 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9edc8128-1dcb-407f-b365-27e9f9e5ebcf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.256524 May 31 18:30:14.412066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 258/507] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:14 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:14.538372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:14.538984 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:14.541590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:14.550887 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:14.551692 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:14.552667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:14.553038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:14.878287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:14.886352 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6a5a565f-752c-4daf-adf6-de54f682fa5e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.352471 May 31 18:30:14.887064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 250/508] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:14 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:15.429733 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:15.430348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:15.437906 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.438347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.439122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.439545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.554633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:15.555483 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:15.563836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.564319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.565086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.566304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.598663 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:30:15.601701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:15.615559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-18006801-9c33-4d6b-bf23-33c0566d9395 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.189600 May 31 18:30:15.626047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 259/509] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:15 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:15.693471 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-82780512-da93-4aa8-8d86-6e3261652b84 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "DELETE /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 204 len: 0 microversion: 2.1 time: 0.143248 May 31 18:30:15.694046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 251/510] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:30:15 2022] DELETE /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 18:30:15.704155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:15.704770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:15.716801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.716801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.716801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.716801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.863963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:15.872340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aa5cfd55-228e-4263-ab1c-6a31a03bade1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1558 microversion: 2.1 time: 0.173575 May 31 18:30:15.872893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 260/511] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:15 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:15.904067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:15.904863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:15.910756 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.911201 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:15.911950 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:15.912410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:16.044948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:16.052789 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-47a60bdd-e9f6-4782-adde-7acf4c45d139 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.153556 May 31 18:30:16.053346 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 252/512] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:15 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:16.633305 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:16.633944 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:16.640675 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:16.641065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:16.641853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:16.642317 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:16.781627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:16.791349 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-773f3bf1-6ad8-4993-95d0-007380d7f2f0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.161292 May 31 18:30:16.791909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 261/513] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:16 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:16.890655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:16.891951 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:16.903408 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:16.903859 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:16.904860 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:16.905326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:17.062533 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:17.069563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:17.070255 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:17.070550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-07069cec-b4fb-46d7-8947-b9dc6050f951 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1558 microversion: 2.1 time: 0.184159 May 31 18:30:17.071354 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 253/514] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:16 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1558 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:17.077216 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:17.077955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:17.078880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:17.079313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:17.211221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:17.220005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3940e8aa-1294-4f2a-99df-bd920459266d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.154236 May 31 18:30:17.220631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 262/515] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:17 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:17.808643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:17.809247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:17.815138 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:17.815914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:17.817201 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:17.817862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:17.986802 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:17.995230 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-88060f37-430a-44dc-b5d1-4765794c174e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.190989 May 31 18:30:17.995836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 254/516] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:17 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:18.088308 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:18.088943 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:18.096495 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:18.097145 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:18.097933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:18.098344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:18.240362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:18.240901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:18.256562 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:18.257029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:18.257804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:18.258545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:18.394194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:18.410474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2875475e-82ac-4c24-8635-711f6fb19fc6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1512 microversion: 2.1 time: 0.326584 May 31 18:30:18.411455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 263/517] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:18 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:18.466980 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:18.476772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b39bb385-900d-46fc-8949-34ec9222307f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.242076 May 31 18:30:18.477454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 255/518] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:18 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:19.013635 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:19.014274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:19.020387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:19.020837 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:19.021828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:19.022264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:19.176973 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:19.185915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a1b0fdb7-a086-423f-9412-be061f8c88fa tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.176999 May 31 18:30:19.186879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 264/519] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:19 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:19.427259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:19.428065 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:19.437203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:19.438267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:19.439222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:19.439652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:19.495890 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:19.496779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:19.504150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:19.504790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:19.505984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:19.506594 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:19.725737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:19.735000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-999c92d8-0cff-4734-b2d9-f1e3f8f36395 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1512 microversion: 2.1 time: 0.311607 May 31 18:30:19.735926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 256/520] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:19 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:19.780176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:19.790370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e1936f13-3aa1-45b1-9a59-5f2a9a712f45 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.300210 May 31 18:30:19.800269 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 265/521] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:19 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:20.208934 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:20.209574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:20.216114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.216645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:20.217532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.221773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:20.362885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:20.371607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5543dce0-3853-4e47-8d77-a2f52a0de01b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.166452 May 31 18:30:20.372550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 257/522] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:20 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:20.590991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-990f84cb-0f92-426e-becf-c674ca5d21f1 req-3e2a9a21-d5a1-4e9a-b253-1816e43f549b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635bcc80-e6b1-4b95-aefb-4aa155a59f4e", "name": "network-vif-plugged", "status": "completed", "tag": "0a09d26b-1e9d-4f38-a3ee-457e3ceb3332"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:30:20.601335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-990f84cb-0f92-426e-becf-c674ca5d21f1 req-3e2a9a21-d5a1-4e9a-b253-1816e43f549b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.601567 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-990f84cb-0f92-426e-becf-c674ca5d21f1 req-3e2a9a21-d5a1-4e9a-b253-1816e43f549b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:20.615244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-990f84cb-0f92-426e-becf-c674ca5d21f1 req-3e2a9a21-d5a1-4e9a-b253-1816e43f549b service nova] Creating event network-vif-plugged:0a09d26b-1e9d-4f38-a3ee-457e3ceb3332 for instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e on hv-cinder-83979 May 31 18:30:20.620180 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-990f84cb-0f92-426e-becf-c674ca5d21f1 req-3e2a9a21-d5a1-4e9a-b253-1816e43f549b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035195 May 31 18:30:20.621037 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 266/523] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:30:20.755031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:20.755647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:20.763021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.763456 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:20.765307 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.765750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:20.810781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:20.811486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:20.817709 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.818147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:20.818937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:20.819480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:21.002766 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:21.010995 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4a7ccb5f-ead2-489f-a8bd-75b0d6eb7907 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1512 microversion: 2.1 time: 0.260013 May 31 18:30:21.011641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 258/524] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:20 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:21.043968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:21.051504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-45bfac10-0060-49e1-8c11-ae5dd634c7fb tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.246550 May 31 18:30:21.052168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 267/525] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:20 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:21.391351 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:21.391925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:21.398509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:21.399167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:21.400303 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:21.400889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:21.542749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:21.551384 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6c180ac7-08ba-4526-8ddb-7a98196366ad tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.163842 May 31 18:30:21.551953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 259/526] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:21 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:22.030611 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:22.031331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:22.043363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:22.044276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:22.047384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:22.047876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:22.070607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:22.072605 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:22.079594 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:22.080350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:22.081335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:22.081974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:22.272810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:22.283922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b00b4230-7b20-46b9-807b-972905b99640 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1512 microversion: 2.1 time: 0.258995 May 31 18:30:22.284532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 268/527] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:22 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1512 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:22.299281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:22.308431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9b01a4b8-8361-4845-995b-54155842cdce tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.241424 May 31 18:30:22.309015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 260/528] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:22 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:22.575065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:22.575690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:22.582153 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:22.582605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:22.583379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:22.583815 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:22.724760 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:22.732947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3f4706d0-3367-4c88-a13d-3635f860a59c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.167049 May 31 18:30:22.733513 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 269/529] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:22 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:23.302203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:23.302724 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:23.310672 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:23.311217 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:23.312501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:23.313004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:23.357141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:23.357776 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:23.379410 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:23.380297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:23.381471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:23.382109 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:23.981925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:23.989755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3a74338f-f584-47e3-9d43-6b96fadedd28 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.668465 May 31 18:30:23.995420 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:23.999328 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 270/530] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:23 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:24.004590 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:24.004872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-93ea1246-7642-4113-9df5-1ecc90d6b4e6 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1512 microversion: 2.1 time: 0.706803 May 31 18:30:24.005585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:24.007848 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 261/531] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:23 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1512 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:24.012814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:24.013494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:24.014266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:24.014703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:24.240522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:24.249857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-38a6193a-6e2d-4980-9488-de4e1b5cee71 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.249171 May 31 18:30:24.250714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 271/532] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:23 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:24.397614 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-5c7b040c-0c68-4e2d-90dc-64ab098d0116 req-7cf8077c-1faf-44ef-98e8-9db5345dc8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41810a2c-bfad-475c-93a8-1c3a3849fa15", "name": "network-vif-unplugged", "status": "completed", "tag": "6b042e87-8779-4fdb-b82b-8fc9b4eca334"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:30:24.411432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-5c7b040c-0c68-4e2d-90dc-64ab098d0116 req-7cf8077c-1faf-44ef-98e8-9db5345dc8e5 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:24.413700 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-5c7b040c-0c68-4e2d-90dc-64ab098d0116 req-7cf8077c-1faf-44ef-98e8-9db5345dc8e5 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:24.427375 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-5c7b040c-0c68-4e2d-90dc-64ab098d0116 req-7cf8077c-1faf-44ef-98e8-9db5345dc8e5 service nova] Creating event network-vif-unplugged:6b042e87-8779-4fdb-b82b-8fc9b4eca334 for instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 on hv-cinder-83979 May 31 18:30:24.432829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-5c7b040c-0c68-4e2d-90dc-64ab098d0116 req-7cf8077c-1faf-44ef-98e8-9db5345dc8e5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038791 May 31 18:30:24.433423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 262/533] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:30:25.025788 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:25.026671 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:25.027353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:25.027980 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:25.033856 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:25.034320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:25.035115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:25.035550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:25.037397 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:25.037865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:25.043036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:25.043492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:25.346938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:25.355410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-297f3b61-8d1a-4c61-b2e1-d757e202f628 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1512 microversion: 2.1 time: 0.335047 May 31 18:30:25.365382 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 263/534] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:25 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1512 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:25.379276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:25.388831 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:25.389452 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:25.395056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a462c903-3013-44ce-b5d2-b01649f50922 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.392126 May 31 18:30:25.395787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 272/535] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:25 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:25.399617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:25.400247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:25.401176 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:25.401748 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:25.418957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:25.577960 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:25.589973 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0c40a203-ee58-4d79-b955-246589de39f2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.221649 May 31 18:30:25.590680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 264/536] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:25 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:26.374043 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:26.375325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:26.382315 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.383416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.384933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.385598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.412710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:26.418841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:26.442324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.442869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.443723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.444258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.476324 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:26.480596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:26.485598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6f86f2ea-4c4d-423c-8769-cb13961023d1 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1470 microversion: 2.1 time: 0.116262 May 31 18:30:26.486474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 273/537] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:26 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1470 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:26.648842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:26.664393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-adcba221-4348-4193-a87c-3160468658c7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.255346 May 31 18:30:26.664997 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 265/538] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:26 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:26.673636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:26.674484 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:26.681830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.683319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.684370 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.685200 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.901514 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-729c1fd2-848f-4e94-8198-6690d1f0bf82 req-3d6ae23b-68bb-4ccd-a151-70f456788eaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41810a2c-bfad-475c-93a8-1c3a3849fa15", "name": "network-vif-deleted", "tag": "6b042e87-8779-4fdb-b82b-8fc9b4eca334"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:30:26.910122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-729c1fd2-848f-4e94-8198-6690d1f0bf82 req-3d6ae23b-68bb-4ccd-a151-70f456788eaa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:26.910571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-729c1fd2-848f-4e94-8198-6690d1f0bf82 req-3d6ae23b-68bb-4ccd-a151-70f456788eaa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:26.921160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:26.922270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-729c1fd2-848f-4e94-8198-6690d1f0bf82 req-3d6ae23b-68bb-4ccd-a151-70f456788eaa service nova] Creating event network-vif-deleted:6b042e87-8779-4fdb-b82b-8fc9b4eca334 for instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 on hv-cinder-83979 May 31 18:30:26.928231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-729c1fd2-848f-4e94-8198-6690d1f0bf82 req-3d6ae23b-68bb-4ccd-a151-70f456788eaa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.439765 May 31 18:30:26.929134 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 274/539] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:30:26.935451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a208adca-3692-4d9e-89c6-4357ca0d80d2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.268262 May 31 18:30:26.936220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 266/540] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:26 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:27.505628 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:27.506851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:27.514354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.515081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:27.516214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.516956 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:27.555092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.556130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:27.556779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lazy-loading 'fault' on Instance uuid 41810a2c-bfad-475c-93a8-1c3a3849fa15 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:30:27.630922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efaf39eaa1f24350b03960716b5d837e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd08b32a2616b44f9b4cdcb0bdb898044', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:27.646886 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8ebf1755-023f-4921-b2c3-d0e7aa815355 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 200 len: 1308 microversion: 2.1 time: 0.147165 May 31 18:30:27.648224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 275/541] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:27 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 1308 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:27.685324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:27.685862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:27.693865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.694404 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:27.695270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.695768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:27.935718 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:27.949502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8f953206-381c-46cc-bba8-a6751efa133d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1367 microversion: 2.1 time: 0.268723 May 31 18:30:27.950371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 267/542] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:27 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1367 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:27.964019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:27.964908 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:27.971188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.971632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:27.979050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:27.979766 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:28.246971 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:28.259471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d4ba40ce-a2ac-40a3-ada4-6c6041f46415 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.309281 May 31 18:30:28.269390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 276/543] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:27 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:28.664491 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:28.666168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] [instance: 41810a2c-bfad-475c-93a8-1c3a3849fa15] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:28.673121 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:28.673565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:28.674325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:28.674764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:28.691249 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] HTTP exception thrown: Instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 could not be found. May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Request method failure captured: May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 HTTP/1.1 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill26msA4wpcfUKW6wD3XagNNp4MzzZHbOevkbtDhr-UVUnSuZdABt9qHo2TcMhEZDhnBYtCOhVpiyjfSDUQg_3zpwQf67g-GBHatJFzbfcfpT25li6a1PfwGwoGq4J4urpJSTGAxRaW3CBJdELwm8E0JEuLxu98OOPXE3UBbB3Spby0 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: d08b32a2616b44f9b4cdcb0bdb898044 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesSnapshotTestJSON-889051698 May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:30:28.692953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/d08b32a2616b44f9b4cdcb0bdb898044"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesSnapshotTestJSON-889051698 May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: d08b32a2616b44f9b4cdcb0bdb898044 May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-889051698 May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesSnapshotTestJSON-889051698-project May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: efaf39eaa1f24350b03960716b5d837e May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesSnapshotTestJSON-889051698-project May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 could not be found. May 31 18:30:28.694302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '41810a2c-bfad-475c-93a8-1c3a3849fa15'} May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 could not be found. May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:30:28.695082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 could not be found. May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 could not be found. May 31 18:30:28.699955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:30:28.701552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] Returning 404 to user: Instance 41810a2c-bfad-475c-93a8-1c3a3849fa15 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:30:28.701552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8359e78e-81eb-40e0-ab33-0396d85ad558 tempest-VolumesSnapshotTestJSON-889051698 tempest-VolumesSnapshotTestJSON-889051698-project] 10.222.0.17 "GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15" status: 404 len: 111 microversion: 2.1 time: 0.033620 May 31 18:30:28.701552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 268/544] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:28 2022] GET /compute/v2.1/servers/41810a2c-bfad-475c-93a8-1c3a3849fa15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:30:28.967231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:28.968585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:28.976187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:28.976865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:28.977797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:28.978423 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:29.277853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:29.278646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:29.286639 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:29.287455 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:29.288561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:29.289096 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:29.332960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:29.348889 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-84228f9a-1808-4c07-8968-5d2e4f942fae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1556 microversion: 2.1 time: 0.385367 May 31 18:30:29.349824 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 277/545] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:28 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1556 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:29.365953 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:29.366713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:29.389189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:29.389652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:29.390441 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:29.391152 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:29.611355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9ea5bf05-e675-4338-91da-7e098aa216b3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.249603 May 31 18:30:29.612480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 278/546] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:30:29 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/os-interface => generated 284 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:30:29.664592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:29.675574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-29587317-80f7-45c3-8f3d-def53eea7c01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.402347 May 31 18:30:29.686958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 269/547] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:29 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:30:30.693869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:30.695136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:30.716767 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:30.717227 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:30.724501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:30.724960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:31.161422 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:31.196195 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-36b5bfc7-622b-46b5-98e7-af88fe0d5123 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.506394 May 31 18:30:31.205475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 279/548] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:30 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:31.494158 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-cd107172-7b83-4387-a453-223bce9e1c91 req-512e0dcc-5554-45cb-a93f-3dd20dfc15d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635bcc80-e6b1-4b95-aefb-4aa155a59f4e", "tag": "0a09d26b-1e9d-4f38-a3ee-457e3ceb3332"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:30:31.505469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-cd107172-7b83-4387-a453-223bce9e1c91 req-512e0dcc-5554-45cb-a93f-3dd20dfc15d4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:31.506322 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-cd107172-7b83-4387-a453-223bce9e1c91 req-512e0dcc-5554-45cb-a93f-3dd20dfc15d4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:31.520887 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-cd107172-7b83-4387-a453-223bce9e1c91 req-512e0dcc-5554-45cb-a93f-3dd20dfc15d4 service nova] Creating event network-changed:0a09d26b-1e9d-4f38-a3ee-457e3ceb3332 for instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e on hv-cinder-83979 May 31 18:30:31.528456 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-cd107172-7b83-4387-a453-223bce9e1c91 req-512e0dcc-5554-45cb-a93f-3dd20dfc15d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121307 May 31 18:30:31.529442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 270/549] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:30:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:30:32.219864 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:32.220573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:32.228135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:32.230059 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:32.231180 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:32.231854 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:32.489188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:32.501533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-55f05889-92ee-44f3-9c49-9a93719f61d6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.283950 May 31 18:30:32.503136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 280/550] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:32 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:32.826039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ebe9fb91-e1e9-4178-86a7-37799f0b49d6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Action: 'create', calling method: .version_select at 0x7ffb6efdb040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1396923003", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZUDZoqCuM7qYa3h+Hv3mk0QMFxVaIMxL9Arkp8aEZb224VPpka2IadvV1z9Wie3jhR0BxBkiQ3kCnY6eDCEFCC6XYodtZDOabQ7i3HA/8KyaUG4TIir/R+gVr0vuLHnQ=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:30:32.844067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-ebe9fb91-e1e9-4178-86a7-37799f0b49d6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Getting quotas for project 1e7d985181c9439cbc10711bb34c0431. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:30:32.849128 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-ebe9fb91-e1e9-4178-86a7-37799f0b49d6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Getting quotas for user 033cd9363e244fd981665ff6611f5e00 and project 1e7d985181c9439cbc10711bb34c0431. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:30:32.921216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ebe9fb91-e1e9-4178-86a7-37799f0b49d6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.284254 May 31 18:30:32.926208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 271/551] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:30:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:30:33.519787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:33.525142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:33.533960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:33.534699 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:33.535762 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:33.537417 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:33.736117 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:33.745632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-af433e2e-7f5d-4c58-be1a-5bbb62dc8ab9 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.231328 May 31 18:30:33.750593 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 281/552] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:33 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:34.771400 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:34.773582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:34.802960 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:34.805907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:34.809790 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:34.810246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:35.221139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:35.251670 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fc35442f-4de0-46f2-a650-11c6c40c17b0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.488889 May 31 18:30:35.253938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 272/553] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:34 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:36.277200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:36.278911 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:36.291717 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:36.292894 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:36.293867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:36.294443 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:36.470364 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:36.482607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5bd1a748-b54d-4030-acd3-e04604f791c8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.211266 May 31 18:30:36.484619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 282/554] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:36 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:37.501187 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:37.502640 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:37.510463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:37.511170 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:37.512146 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:37.512738 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:37.679677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:37.698433 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-39eeb829-8d8d-4f9c-b717-d35e168bb36e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.201231 May 31 18:30:37.699393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 273/555] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:37 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:38.719364 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:38.720488 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:38.727804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:38.728399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:38.729278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:38.729814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:38.883000 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:38.892436 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1f138f0f-00a8-4e03-acc7-cec41aba1350 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.179716 May 31 18:30:38.892996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 283/556] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:38 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:39.912578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:39.913206 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:39.923452 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:39.923908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:39.925998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:39.926620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:40.137586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:40.153182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3b26c070-7091-42d1-91e3-340e942fcdc5 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.244284 May 31 18:30:40.153770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 274/557] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:39 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:41.170949 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:41.171569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:41.174258 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=60 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:41.179566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:41.180635 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:41.181427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:41.181864 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:41.322757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:41.330985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ec561b36-e19b-47ab-b411-dc0a5a720568 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.164023 May 31 18:30:41.331546 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 284/558] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:41 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:42.348462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:42.349070 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:42.355459 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:42.356021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:42.356865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:42.357301 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:42.485712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:42.494221 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6e42f836-2bd9-41aa-a445-20c1a70bc44d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.149785 May 31 18:30:42.494782 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 275/559] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:42 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:43.511322 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:43.511933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:43.518657 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:43.519173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:43.519948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:43.520418 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:43.663373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:43.671899 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0e55e0a2-5d9f-4eee-a568-9d4c4f7aca0e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.165122 May 31 18:30:43.672471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 285/560] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:43 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:44.688628 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:44.689232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:44.691171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:44.692316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:30:44.699448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:44.699716 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:44.706223 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:44.706223 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:44.836865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:44.844834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-600bef54-1d56-4627-b212-9f4d04e885db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.159938 May 31 18:30:44.845402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 276/561] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:44 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:45.862535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:45.863071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:45.869791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:45.870238 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:45.871023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:45.871457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:46.011366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:46.019336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-11a7f770-65d2-44eb-89f4-30667c9e241a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1723 microversion: 2.1 time: 0.160878 May 31 18:30:46.019895 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 286/562] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:45 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:47.038915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:47.039468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:47.045999 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:47.046447 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:47.047206 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:47.047703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:47.179106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:47.187522 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3d6b375c-520c-416a-9426-0be0ccc76041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1700 microversion: 2.1 time: 0.152527 May 31 18:30:47.188082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 277/563] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:47 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1700 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:47.204569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2a8bddb2-d8b2-4cca-90b1-92f83b97b5ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:30:47.211072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a8bddb2-d8b2-4cca-90b1-92f83b97b5ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:47.211522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2a8bddb2-d8b2-4cca-90b1-92f83b97b5ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:47.271246 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2a8bddb2-d8b2-4cca-90b1-92f83b97b5ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Going to try to start instance {{(pid=117589) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 18:30:47.314633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2a8bddb2-d8b2-4cca-90b1-92f83b97b5ec tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action" status: 202 len: 0 microversion: 2.1 time: 0.113760 May 31 18:30:47.315226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 287/564] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:30:47 2022] POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:30:47.324548 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:47.325168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:47.331762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:47.332472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:47.333408 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:47.333960 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:47.473541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:47.482312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-83bf6b5e-1782-40fd-884c-b07f45ca0e44 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1709 microversion: 2.1 time: 0.162882 May 31 18:30:47.482873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 278/565] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:47 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1709 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:48.499530 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:48.500245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:48.508235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:48.508684 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:48.509446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:48.510373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:48.663421 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:48.672277 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aca223fa-df3e-4d33-8b13-f60b691eb220 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1709 microversion: 2.1 time: 0.177077 May 31 18:30:48.672901 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 288/566] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:48 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1709 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:30:49.689728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:30:49.690342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:30:49.696926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:49.697404 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:49.698177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:30:49.698610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:30:49.835722 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:30:49.845850 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1b53ec51-7b57-4dcc-a181-6f765c8d8130 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1713 microversion: 2.1 time: 0.159755 May 31 18:30:49.846494 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 279/567] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:30:49 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1713 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:02.574956 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1796614919", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1396923003", "security_groups": [{"name": "tempest-secgroup-smoke-1403505973"}], "networks": [{"uuid": "3fdc950a-966a-4f31-a419-a5c563ad9c7d"}], "block_device_mapping_v2": [{"uuid": "717ce984-5421-49bb-9006-31ee62979d9b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:02.583880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=9 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:02.584575 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:02.687651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] validate_networks() for [('3fdc950a-966a-4f31-a419-a5c563ad9c7d', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:31:03.158117 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:31:03.158545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:31:03.159024 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:31:03.159439 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:31:03.159884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:31:03.169387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:03.169832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:03.170630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:03.171107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:03.188118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Getting quotas for project 1e7d985181c9439cbc10711bb34c0431. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:31:03.191995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Getting quotas for user 033cd9363e244fd981665ff6611f5e00 and project 1e7d985181c9439cbc10711bb34c0431. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:31:03.248015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:31:03.250101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='717ce984-5421-49bb-9006-31ee62979d9b',volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:31:03.381749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-26287a96-335a-49d9-ac03-ae1c64a39b1d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.811186 May 31 18:31:03.382836 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 289/568] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:31:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:31:03.394557 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-99a990b4-8d88-4642-817b-347545ee2265 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:03.395165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-99a990b4-8d88-4642-817b-347545ee2265 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:03.397607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=7 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:03.398265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=79 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:03.452304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-99a990b4-8d88-4642-817b-347545ee2265 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:03.458905 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-99a990b4-8d88-4642-817b-347545ee2265 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1089 microversion: 2.1 time: 0.068202 May 31 18:31:03.459499 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 280/569] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:03 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:04.475702 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:04.476331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:04.483511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:04.483951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:04.484725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:04.485155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:04.545738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:04.553041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9fe39b34-e95c-4eb6-a26b-8cc883d8d154 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1139 microversion: 2.1 time: 0.081661 May 31 18:31:04.553591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 290/570] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:04 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1139 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:05.569782 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:05.570392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:05.576892 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:05.577338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:05.578094 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:05.578544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:05.638308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:05.645626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-25fcee49-3d22-45b5-962d-e9ea47e97102 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1139 microversion: 2.1 time: 0.079713 May 31 18:31:05.646179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 281/571] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:05 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1139 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:06.662794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:06.663396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:06.670332 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:06.670787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:06.671538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:06.671968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:06.738115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:06.746791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-06d6c1b4-8fff-4bfe-9f31-6a9c24e64eac tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1187 microversion: 2.1 time: 0.087698 May 31 18:31:06.747605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 291/572] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:06 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:07.764832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:07.765469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:07.774122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:07.775130 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:07.776106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:07.776714 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:08.050812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:08.059197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0f965387-5aec-4816-8403-328ebf79620c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1273 microversion: 2.1 time: 0.298536 May 31 18:31:08.059775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 282/573] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:07 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1273 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:08.433354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-8c682523-408a-4f62-9116-6db924862272 req-ccce328e-9979-4222-b626-3375484ccd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:08.448406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-8c682523-408a-4f62-9116-6db924862272 req-ccce328e-9979-4222-b626-3375484ccd78 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:08.448870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-8c682523-408a-4f62-9116-6db924862272 req-ccce328e-9979-4222-b626-3375484ccd78 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:08.460911 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-8c682523-408a-4f62-9116-6db924862272 req-ccce328e-9979-4222-b626-3375484ccd78 service nova] Creating event network-changed:1d0bca79-ab73-4643-a78f-e91fb3ea863b for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c on hv-cinder-83979 May 31 18:31:08.467094 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-8c682523-408a-4f62-9116-6db924862272 req-ccce328e-9979-4222-b626-3375484ccd78 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046623 May 31 18:31:08.468023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 292/574] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:31:08.695188 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "93898d3a-3afa-46c0-8f1c-d06de0140eff"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:08.696364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:08.704862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:08.705313 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:08.707275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:08.708232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:08.989409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-df2348f3-4a78-4409-94d9-c433da906f9f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502158 May 31 18:31:08.990078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 283/575] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:31:08 2022] POST /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:31:09.076516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:09.077209 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:09.083609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:09.084052 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:09.084864 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:09.085314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:09.220625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:09.228640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-72b27d21-33bd-41b0-9bfc-d61a36a9d24d tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.155755 May 31 18:31:09.229535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 293/576] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:09 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:10.250684 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:10.251647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:10.262764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:10.263216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:10.264002 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:10.264854 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:10.530061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:10.537392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3f58c4ee-e2d1-4d63-913b-036215973961 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.294867 May 31 18:31:10.537964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 284/577] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:10 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:11.554800 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:11.555425 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:11.562271 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:11.562712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:11.563467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:11.563925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:11.692982 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:11.700985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-da005c39-36af-4c8b-a543-3365683cd3c0 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.150016 May 31 18:31:11.701542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 294/578] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:11 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:12.718205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:12.718886 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:12.725185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:12.725631 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:12.726387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:12.726818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:12.862396 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:12.869878 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-636a03b8-5d52-4fd6-a77a-4fab1227cc3f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.155501 May 31 18:31:12.870469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 285/579] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:12 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:13.890382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:13.890988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:13.893569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:13.894218 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=6 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:13.901346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:13.901986 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:13.902755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:13.903183 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:14.035067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:14.042598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-87d3fc37-76c3-4c2d-a222-9faaabef45cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.156228 May 31 18:31:14.043150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 295/580] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:13 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:15.059886 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:15.060431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:15.062787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:15.068060 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:15.068601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:15.069398 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:15.069829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:15.199445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:15.206739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2c5ba43b-2c3a-41da-a713-5f0abace36cf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.151479 May 31 18:31:15.207294 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 286/581] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:15 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:16.224119 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:16.224732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:16.230850 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:16.231293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:16.232048 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:16.232535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:16.367170 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:16.375759 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-815c9774-af1d-4925-85c5-2d75a330ec58 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.155569 May 31 18:31:16.376562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 296/582] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:16 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:17.392808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:17.393537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:17.400606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:17.401053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:17.401818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:17.402253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:17.546167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:17.553666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-252275dc-70f9-497f-b6ee-ed4415063345 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.164676 May 31 18:31:17.554427 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 287/583] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:17 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:18.570590 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:18.572019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:18.578185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:18.578633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:18.579439 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:18.579876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:18.603718 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:18.604759 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:18.611116 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:18.611567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:18.612367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:18.612804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:18.636260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lazy-loading 'flavor' on Instance uuid 549e1c59-1ba0-4754-b95c-49ac8e3cc547 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:31:18.716292 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:18.723915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-01c8c74e-fecc-40ef-a0cc-a8d90e364d34 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.157099 May 31 18:31:18.724701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 297/584] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:18 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:18.804525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-20cdc2a1-c43e-4977-8309-379920515623 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/action" status: 200 len: 32 microversion: 2.1 time: 0.204756 May 31 18:31:18.805131 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 288/585] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:31:18 2022] POST /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/action => generated 32 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 18:31:18.814385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:18.815019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:18.821680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:18.822206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:18.823023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:18.823509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:19.039744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:19.047638 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e8d0fdc6-ae07-4acd-b163-e5510b633635 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.237060 May 31 18:31:19.048220 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 298/586] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:18 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:19.745887 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:19.747096 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:19.753870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:19.754320 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:19.755232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:19.755674 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:19.890751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:19.898318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5743224b-d026-4c61-9367-6300f4b18cd3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.161199 May 31 18:31:19.898879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 299/587] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:19 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:31:19.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-a730d4b9-2dc5-452f-afa4-4c8b39e984d7 req-1266082a-ef2e-4397-addf-48192217b664 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "name": "network-vif-plugged", "status": "completed", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:19.945704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a730d4b9-2dc5-452f-afa4-4c8b39e984d7 req-1266082a-ef2e-4397-addf-48192217b664 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:19.946253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a730d4b9-2dc5-452f-afa4-4c8b39e984d7 req-1266082a-ef2e-4397-addf-48192217b664 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:19.956226 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-a730d4b9-2dc5-452f-afa4-4c8b39e984d7 req-1266082a-ef2e-4397-addf-48192217b664 service nova] Creating event network-vif-plugged:1d0bca79-ab73-4643-a78f-e91fb3ea863b for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c on hv-cinder-83979 May 31 18:31:19.960996 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-a730d4b9-2dc5-452f-afa4-4c8b39e984d7 req-1266082a-ef2e-4397-addf-48192217b664 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.228509 May 31 18:31:19.962079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 289/588] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:31:20.065858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:20.066473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:20.073680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:20.074127 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:20.074900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:20.075339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:20.218768 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:20.226713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d0a848fc-0883-43e8-809e-eaa0f7e6ac5a tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.164758 May 31 18:31:20.227880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 300/589] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:20 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:20.917423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:20.918118 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:20.924272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:20.924722 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:20.925474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:20.925906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:21.063987 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:21.071728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2b64bb93-2458-4a52-8c33-472c651fc494 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1261 microversion: 2.1 time: 0.159622 May 31 18:31:21.072324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 290/590] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:20 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:21.249115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:21.249723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:21.256382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:21.256827 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:21.257586 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:21.258019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:21.383831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:21.391726 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8e891632-c4a5-4e98-b1e7-c471307aaba2 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.146553 May 31 18:31:21.392326 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 301/591] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:21 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:22.088438 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:22.089051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:22.095395 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:22.095847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:22.096646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:22.097083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:22.228368 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:22.235761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d85f89c7-24c4-4f61-a289-59aca7c13000 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1446 microversion: 2.1 time: 0.151278 May 31 18:31:22.236349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 291/592] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:22 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1446 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:22.252185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:22.252794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:22.259804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:22.260284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:22.261141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:22.261632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:22.396605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:22.409550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:22.410007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cf89e2bb-fed1-41ef-aa37-2a6ac0f1315c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1446 microversion: 2.1 time: 0.161732 May 31 18:31:22.410140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:22.410835 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 302/593] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:22 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:22.416829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:22.417277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:22.418042 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:22.418474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:22.549027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:22.557732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1e5401ad-75ac-4f25-a9db-cc084a606c0c tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.152156 May 31 18:31:22.558230 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 292/594] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:22 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:31:23.574719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:23.575315 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:23.581634 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:23.582083 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:23.582863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:23.583280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:23.783461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:23.791249 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b1dafc21-d642-4a0e-93a7-43094d3e8218 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.220437 May 31 18:31:23.791813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 303/595] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:23 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:24.465071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-cc37bd53-f09e-4704-acbd-946b37a7241f req-3e86b4b9-4699-4467-ae28-d5be79e6346c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:24.473470 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-cc37bd53-f09e-4704-acbd-946b37a7241f req-3e86b4b9-4699-4467-ae28-d5be79e6346c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:24.473901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-cc37bd53-f09e-4704-acbd-946b37a7241f req-3e86b4b9-4699-4467-ae28-d5be79e6346c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:24.485368 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-cc37bd53-f09e-4704-acbd-946b37a7241f req-3e86b4b9-4699-4467-ae28-d5be79e6346c service nova] Creating event network-changed:1d0bca79-ab73-4643-a78f-e91fb3ea863b for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c on hv-cinder-83979 May 31 18:31:24.490096 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-cc37bd53-f09e-4704-acbd-946b37a7241f req-3e86b4b9-4699-4467-ae28-d5be79e6346c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029687 May 31 18:31:24.490681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 293/596] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:31:24.808413 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:24.809023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:24.815702 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:24.816263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:24.817147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:24.817787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:25.037569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:25.046836 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d765de01-1c17-41e2-a409-160844fd6ddd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.242464 May 31 18:31:25.047770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 304/597] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:24 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:26.066104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:26.066797 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:26.073695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:26.074158 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:26.074909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:26.075341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:26.207372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:26.216238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e82f98e1-a843-47f8-b80c-2d819049ce2e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.154872 May 31 18:31:26.216797 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 294/598] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:26 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:27.234040 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:27.234647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:27.241010 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:27.241453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:27.242206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:27.243365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:27.370970 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:27.379073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-03b3f5db-517b-4504-911d-c4778386a3e3 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.149223 May 31 18:31:27.379654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 305/599] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:27 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:28.397613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:28.398220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:28.405576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:28.406025 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:28.406772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:28.407199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:28.425265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:28.541008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:28.548788 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-395d23b3-9bab-424c-bf59-9f1359380fb5 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.155308 May 31 18:31:28.549355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 295/600] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:28 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:29.566048 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:29.566645 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:29.573996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:29.574444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:29.575206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:29.575641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:29.708381 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:29.712053 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:29.717161 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7d39e0c7-4bca-4a7e-9678-14a305d0e6a0 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.155050 May 31 18:31:29.717715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 306/601] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:29 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:30.734087 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:30.734702 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:30.741334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:30.741785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:30.743236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:30.744307 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:30.870088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:30.878249 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-daf7258a-61e1-4d90-a620-c3c126c76e88 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.147984 May 31 18:31:30.878816 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 296/602] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:30 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:31.895673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:31.896376 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:31.903555 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:31.903996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:31.904801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:31.905242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:32.034587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:32.042936 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0cd2624e-c388-41a9-b74d-6409d34b628d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.151462 May 31 18:31:32.043504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 307/603] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:31 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:33.060715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:33.061324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:33.067916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:33.068395 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:33.069165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:33.069608 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:33.199279 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:33.207391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-014eff1a-6699-4a33-8407-66896e4f70b7 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.150547 May 31 18:31:33.207962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 297/604] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:33 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:34.225135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:34.225743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:34.228310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:34.233587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:34.234036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:34.234833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:34.235268 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:34.371607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:34.379740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d2504b9b-187e-490f-83c1-c3f1f86ed4fd tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.158418 May 31 18:31:34.380325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 308/605] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:34 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:35.397429 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:35.398038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:35.400906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=39 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:35.406134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:35.406581 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:35.407337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:35.407773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:35.541804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:35.549655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-10af5926-64fb-49df-9c8e-45d46b0f4f98 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.156083 May 31 18:31:35.550205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 298/606] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:35 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:36.567579 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:36.568244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:36.575241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:36.575684 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:36.576472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:36.576902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:36.706680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:36.715031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3bfdd1d8-ebd8-4912-b12c-4dfbbadf93db tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.151255 May 31 18:31:36.715580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 309/607] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:36 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:37.732937 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:37.733553 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:37.740439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:37.740889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:37.741664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:37.742268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:37.873647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:37.881761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d951f9d6-dbfd-4491-baa4-b3f386184efc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.152722 May 31 18:31:37.882321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 299/608] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:37 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:38.899330 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:38.899943 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:38.906376 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:38.906826 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:38.907587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:38.908024 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:39.039875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:39.047862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1d99be4f-9e53-42a5-86e5-574115bd4189 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1733 microversion: 2.1 time: 0.153034 May 31 18:31:39.048399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 310/609] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:38 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:40.064821 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:40.065425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:40.071966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.072435 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.073184 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.073614 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.202290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:40.210108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7c3f3c24-7785-497f-b257-b07179b58f06 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1713 microversion: 2.1 time: 0.149143 May 31 18:31:40.211352 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 300/610] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:40 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1713 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:40.311194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:40.311703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:40.318146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.318533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.319281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.319711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.448278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] HTTP exception thrown: Cannot 'detach_volume' instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 while it is in vm_state rescued May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Request method failure captured: May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments/93898d3a-3afa-46c0-8f1c-d06de0140eff HTTP/1.1 May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill2DZNbmBXSE1I6kZ6AxRSxP2cDbzLVsV8TkpYhf1AGgVyAxGU-dYUYfqXrWp73VKewLownXsTqqprgnTVpT5bmpXn4Yg3dTHk29KSfNUiXM4CPdusn54OtbSKNMsuyT_sOAhFIBv19P3h78udqSVHQfF5fbnbQNMFtxAlwazeE_U24 May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 2628eee87b7147b8866790922d57222c May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:31:40.449861 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2628eee87b7147b8866790922d57222c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2628eee87b7147b8866790922d57222c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 2628eee87b7147b8866790922d57222c May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 39fdc2681def478990bb4b78de5d34ee May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:31:40.451496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Cannot 'detach_volume' instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 while it is in vm_state rescued May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'server_id': '549e1c59-1ba0-4754-b95c-49ac8e3cc547', 'id': '93898d3a-3afa-46c0-8f1c-d06de0140eff'} May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:31:40.452231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 while it is in vm_state rescued May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 while it is in vm_state rescued May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:31:40.453451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Returning 409 to user: Cannot 'detach_volume' instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 while it is in vm_state rescued {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:31:40.454400 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-89643326-0f6b-4db3-ad47-4f7a5989f52b tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments/93898d3a-3afa-46c0-8f1c-d06de0140eff" status: 409 len: 152 microversion: 2.1 time: 0.144037 May 31 18:31:40.454400 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 311/611] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:31:40 2022] DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments/93898d3a-3afa-46c0-8f1c-d06de0140eff => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 31 18:31:40.460021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:40.460836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:40.466826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.467280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.468040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.468507 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.535234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4061f19c-81e5-48dd-b8b6-4765faade991 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "POST /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/action" status: 202 len: 0 microversion: 2.1 time: 0.078833 May 31 18:31:40.535870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 301/612] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:31:40 2022] POST /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:31:40.545902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:40.546841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:40.557365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.558026 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.559185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:40.559849 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:40.779178 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:40.786972 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f713d580-a1bd-4894-b7eb-e64e26c2dd8f tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1721 microversion: 2.1 time: 0.246217 May 31 18:31:40.787531 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 312/613] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:40 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1721 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:41.806203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:41.806899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:41.813513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:41.814185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:41.814951 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:41.815387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:41.946817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:41.954655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e872cddc-4a30-4b25-a3bc-3688c55c2abb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1721 microversion: 2.1 time: 0.153447 May 31 18:31:41.955214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 302/614] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:41 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:42.973125 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:42.973680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:42.981198 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:42.981649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:42.982410 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:42.982845 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:43.113740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:43.121982 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-769187fb-52c5-4bdd-90e2-3430e09ac99e tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1721 microversion: 2.1 time: 0.152934 May 31 18:31:43.122632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 313/615] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:42 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:44.139645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:44.140291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:44.146740 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:44.147188 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:44.147963 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:44.148405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:44.277699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:44.285609 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2e6ebf88-b93b-460b-ae09-4d2b318a0d65 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1721 microversion: 2.1 time: 0.149880 May 31 18:31:44.286169 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 303/616] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:44 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:45.303375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:45.303981 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:45.310600 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:45.311047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:45.311812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:45.312287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:45.442525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:45.451115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-361ee4bd-75ff-46eb-8ef0-55a290a7d036 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1727 microversion: 2.1 time: 0.151764 May 31 18:31:45.451668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 314/617] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:45 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:31:45.467325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:45.467829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:45.474320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:45.474770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:45.475534 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:45.475972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:45.555185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e49ec42e-eee8-43c3-bfd3-1493649da962 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090942 May 31 18:31:45.555790 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 304/618] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:31:45 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:31:46.442399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-084ac943-2dd6-424c-b792-d1ba3707c16f req-67e51db8-2c8a-4ea0-9de3-24f6de3f0619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e1c59-1ba0-4754-b95c-49ac8e3cc547", "tag": "301a1ec7-72c4-46e8-b9de-f5e5d1d3e419"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:46.451062 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-084ac943-2dd6-424c-b792-d1ba3707c16f req-67e51db8-2c8a-4ea0-9de3-24f6de3f0619 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:46.451498 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-084ac943-2dd6-424c-b792-d1ba3707c16f req-67e51db8-2c8a-4ea0-9de3-24f6de3f0619 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:46.465351 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-084ac943-2dd6-424c-b792-d1ba3707c16f req-67e51db8-2c8a-4ea0-9de3-24f6de3f0619 service nova] Creating event network-changed:301a1ec7-72c4-46e8-b9de-f5e5d1d3e419 for instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 on hv-cinder-83979 May 31 18:31:46.471096 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-084ac943-2dd6-424c-b792-d1ba3707c16f req-67e51db8-2c8a-4ea0-9de3-24f6de3f0619 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032253 May 31 18:31:46.471680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 315/619] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:31:48.486539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-a88f1f57-bc37-481b-9529-a3e46b4d9b03 req-e5d9e24b-bb1d-4b7f-b64a-5b100e70364e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "549e1c59-1ba0-4754-b95c-49ac8e3cc547", "tag": "301a1ec7-72c4-46e8-b9de-f5e5d1d3e419"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:48.494947 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a88f1f57-bc37-481b-9529-a3e46b4d9b03 req-e5d9e24b-bb1d-4b7f-b64a-5b100e70364e service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:48.495381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a88f1f57-bc37-481b-9529-a3e46b4d9b03 req-e5d9e24b-bb1d-4b7f-b64a-5b100e70364e service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:48.506177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-a88f1f57-bc37-481b-9529-a3e46b4d9b03 req-e5d9e24b-bb1d-4b7f-b64a-5b100e70364e service nova] Creating event network-changed:301a1ec7-72c4-46e8-b9de-f5e5d1d3e419 for instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 on hv-cinder-83979 May 31 18:31:48.511999 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-a88f1f57-bc37-481b-9529-a3e46b4d9b03 req-e5d9e24b-bb1d-4b7f-b64a-5b100e70364e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029989 May 31 18:31:48.512599 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 305/620] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:31:57.131010 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=15 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:57.131790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=50 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:57.136159 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:57.136779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:57.143896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:57.144405 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:57.145151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:57.145585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:57.230044 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lazy-loading 'services' on Instance uuid ad9cc87a-c08b-48eb-9014-e1a997cd84d7 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:31:57.341900 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ea473462-0d0c-4570-a007-eef46d20d3d3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-volume_attachments/31993f59-2389-4210-91f4-6bdfc8d6789b" status: 202 len: 0 microversion: 2.1 time: 0.211698 May 31 18:31:57.342040 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 316/621] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:31:57 2022] DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-volume_attachments/31993f59-2389-4210-91f4-6bdfc8d6789b => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:31:59.509984 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b956e642-63e3-45f3-a5cd-990dc4272e1d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:31:59.512597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=15 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:59.513238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:31:59.518934 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b956e642-63e3-45f3-a5cd-990dc4272e1d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:59.519380 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b956e642-63e3-45f3-a5cd-990dc4272e1d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:59.542459 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b956e642-63e3-45f3-a5cd-990dc4272e1d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Going to try to stop instance {{(pid=117590) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 18:31:59.583576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b956e642-63e3-45f3-a5cd-990dc4272e1d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action" status: 202 len: 0 microversion: 2.1 time: 0.077692 May 31 18:31:59.584155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 306/622] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:31:59 2022] POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:31:59.594099 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:31:59.594833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:31:59.601821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:59.602272 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:59.603051 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:31:59.603492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:31:59.740541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:31:59.748006 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-98f991e3-80b2-4bdc-90ce-86468ebb3751 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.158824 May 31 18:31:59.748606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 317/623] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:31:59 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:00.767220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:00.767914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:00.774869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.775309 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.776063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.776520 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.793064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:00.793575 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:00.800172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.800625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.801405 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.801846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.826296 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b2b75bb0-d0d4-4c46-af74-be3ff1f7dc8c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/ips" status: 200 len: 149 microversion: 2.1 time: 0.036997 May 31 18:32:00.826858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 318/624] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:32:00 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:32:00.837484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31c633c5-05c7-49af-b743-59775b73b475"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:00.838593 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:00.844610 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.845195 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.846001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.846439 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.907916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:00.915488 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2afb6da9-d01d-4154-965a-29f6479422b3 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.152964 May 31 18:32:00.916265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 307/625] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:00 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:00.925805 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Invalid volume: volume 31c633c5-05c7-49af-b743-59775b73b475 is already attached to instances: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: POST /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/os-volume_attachments HTTP/1.1 May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 74 May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:32:00.927540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {"volumeAttachment": {"volumeId": "31c633c5-05c7-49af-b743-59775b73b475"}} May 31 18:32:00.929832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Invalid volume: volume 31c633c5-05c7-49af-b743-59775b73b475 is already attached to instances: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'server_id': '635bcc80-e6b1-4b95-aefb-4aa155a59f4e', 'body': {'volumeAttachment': {'volumeId': '31c633c5-05c7-49af-b743-59775b73b475'}}} May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 31c633c5-05c7-49af-b743-59775b73b475 is already attached to instances: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:00.930668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 31c633c5-05c7-49af-b743-59775b73b475 is already attached to instances: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:00.931809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 31c633c5-05c7-49af-b743-59775b73b475 is already attached to instances: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 400 to user: Invalid volume: volume 31c633c5-05c7-49af-b743-59775b73b475 is already attached to instances: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f1950bf1-0b45-4cd0-9f08-50b150c9408e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095768 May 31 18:32:00.933222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 319/626] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:32:00 2022] POST /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 18:32:00.938432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:00.938921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:00.945551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.945993 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.946742 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:00.947172 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:00.970542 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:32:01.065568 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-14845c40-aaa8-4ee3-97ca-0035e31bd6a4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 204 len: 0 microversion: 2.1 time: 0.130329 May 31 18:32:01.066306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 308/627] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:32:00 2022] DELETE /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:32:01.075199 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:01.075866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:01.082685 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:01.083188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:01.083958 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:01.084426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:01.216114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:01.223474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6d930574-16f8-4ed4-a9bc-56023373022c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1681 microversion: 2.1 time: 0.152136 May 31 18:32:01.224015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 320/628] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:01 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:01.933339 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:01.934030 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:01.940393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:01.940837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:01.941584 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:01.942013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:02.070768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:02.078201 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-262f0c5e-387f-4eaa-8e31-051ced814521 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.149532 May 31 18:32:02.078761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 309/629] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:01 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:02.240926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:02.241770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:02.248336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:02.248789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:02.249553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:02.249990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:02.378947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:02.387067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d62b09b9-a275-4108-9097-1e6e1ca28b65 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1681 microversion: 2.1 time: 0.149957 May 31 18:32:02.387623 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 321/630] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:02 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:03.094748 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:03.095468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:03.102545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:03.102990 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:03.103750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:03.104201 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:03.405315 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:03.405938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:03.412770 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:03.413929 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:03.415071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:03.415508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:03.610788 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:03.619280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-dad7f63f-a62d-43f7-a993-2146d8e48cdf tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.528399 May 31 18:32:03.619942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 310/631] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:03 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:03.752465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:03.760841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1e2e0a92-5c4f-4e98-8824-0e052d13615c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1681 microversion: 2.1 time: 0.359811 May 31 18:32:03.761398 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 322/632] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:03 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1681 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:32:04.341603 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-ea32ec25-ddde-4688-b5a9-4313b72b2c99 req-31ed2c1b-9775-4478-aae5-8313a81db9bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635bcc80-e6b1-4b95-aefb-4aa155a59f4e", "name": "network-vif-deleted", "tag": "0a09d26b-1e9d-4f38-a3ee-457e3ceb3332"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:04.350283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ea32ec25-ddde-4688-b5a9-4313b72b2c99 req-31ed2c1b-9775-4478-aae5-8313a81db9bc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:04.351508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ea32ec25-ddde-4688-b5a9-4313b72b2c99 req-31ed2c1b-9775-4478-aae5-8313a81db9bc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:04.367975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-ea32ec25-ddde-4688-b5a9-4313b72b2c99 req-31ed2c1b-9775-4478-aae5-8313a81db9bc service nova] Creating event network-vif-deleted:0a09d26b-1e9d-4f38-a3ee-457e3ceb3332 for instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e on hv-cinder-83979 May 31 18:32:04.373225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-ea32ec25-ddde-4688-b5a9-4313b72b2c99 req-31ed2c1b-9775-4478-aae5-8313a81db9bc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035221 May 31 18:32:04.377965 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 311/633] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:04.637009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:04.637919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:04.644667 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:04.645228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:04.646100 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:04.646633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:04.781466 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:04.782491 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:04.785969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:04.790421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:04.791163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:04.792300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:04.793122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:04.794818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-833e3c35-9f2c-4f47-9dba-2f6e4f695683 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.161576 May 31 18:32:04.795820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 323/634] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:04 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:04.989758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:04.990218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:04.990660 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lazy-loading 'fault' on Instance uuid 635bcc80-e6b1-4b95-aefb-4aa155a59f4e {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:32:05.039812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:05.047423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c5ac538a-0e8e-4cc6-8976-65a5b240454d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 200 len: 1331 microversion: 2.1 time: 0.271036 May 31 18:32:05.048425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 312/635] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:04 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 1331 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:32:05.813144 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:05.813760 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:05.820280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:05.820730 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:05.821507 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:05.821944 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:05.952919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:05.960418 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-78a4580f-e8a7-4529-8078-7faa053497c0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.151139 May 31 18:32:05.961195 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 324/636] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:05 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:06.065998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:06.066616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:06.073120 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.073570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.074333 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.074767 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.088067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e HTTP/1.1 May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:32:06.089710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:32:06.091272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '635bcc80-e6b1-4b95-aefb-4aa155a59f4e'} May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:32:06.092168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:32:06.093780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:06.095610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:32:06.095610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d0da97b8-3234-484d-bf9b-a246795c98f5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 404 len: 111 microversion: 2.1 time: 0.029031 May 31 18:32:06.095610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 313/637] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:06 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:32:06.100319 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d541c87b-d309-40ec-bc2c-a2f05a53a21b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '.version_select at 0x7ffb78b0e790>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:06.120169 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d541c87b-d309-40ec-bc2c-a2f05a53a21b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483441887" status: 202 len: 0 microversion: 2.1 time: 0.023491 May 31 18:32:06.120743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 325/638] 10.222.0.17 () {58 vars in 1220 bytes} [Tue May 31 18:32:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1483441887 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:32:06.809882 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:06.810374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:06.816657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.817106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.817867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.818405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.899536 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lazy-loading 'services' on Instance uuid cdb08f80-5f98-4bb9-a683-73f38dfaeb6d {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:32:06.969397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3c70eb4b-7160-4b9e-8daf-c5cf57af0d03 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments/31c633c5-05c7-49af-b743-59775b73b475" status: 202 len: 0 microversion: 2.1 time: 0.163317 May 31 18:32:06.969963 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 314/639] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:32:06 2022] DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments/31c633c5-05c7-49af-b743-59775b73b475 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 18:32:06.978365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:06.978893 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:06.979124 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:06.979746 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:06.985743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.985895 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.986194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.986307 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.986966 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.987078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:06.987407 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:06.987519 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:07.018626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-eea5c572-4fb7-481d-a719-f2f11f6c9812 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 May 31 18:32:07.019532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 315/640] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:32:06 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:07.121875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:07.130461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-be6e3ce9-26cb-4871-aa68-ba29fe5e963b tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.156522 May 31 18:32:07.130937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 326/641] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:06 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:08.031033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:08.031944 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:08.038401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:08.038945 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:08.039727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:08.040185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:08.067798 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e714a780-f8c0-4c93-ab40-d8ce219633f4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040808 May 31 18:32:08.068362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 316/642] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:32:08 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:08.151494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:08.152200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:08.159235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:08.159687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:08.160488 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:08.160939 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:08.290703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:08.298131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a2301050-dba4-4092-8c76-2dbfe56ae933 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.151632 May 31 18:32:08.298692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 327/643] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:08 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:09.081928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:09.083117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:09.095582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.096023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.096806 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.097234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.126755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-27ad6137-c585-4f6a-9367-2957d4548bf4 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050239 May 31 18:32:09.127312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 317/644] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:32:09 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:32:09.185105 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:09.185613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:09.191888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.192370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.193130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.193565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.218014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:32:09.294220 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b5d5debd-cd2b-4974-a34f-5a667f526bc1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 204 len: 0 microversion: 2.1 time: 0.112558 May 31 18:32:09.294820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 328/645] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:32:09 2022] DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:32:09.303042 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:09.303674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:09.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.310302 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.311155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.311580 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.314962 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:09.315666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:09.321523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.321965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.322729 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:09.323162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:09.513865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:09.517827 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:09.521504 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f3fdcea3-b5af-4c6f-b681-66f4277d7e71 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1678 microversion: 2.1 time: 0.222289 May 31 18:32:09.522292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 318/646] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:09 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:09.526293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6068e992-2d8f-4029-851b-f125ef5dc3c2 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1677 microversion: 2.1 time: 0.215425 May 31 18:32:09.526839 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 329/647] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:09 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:32:10.539907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:10.540677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:10.546786 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:10.547412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:10.549680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.550132 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.550906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.551486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.554713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.555157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.555936 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.556407 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.865569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:10.868618 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:10.874287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2e3c5543-b66d-4161-9e00-79381e7e14b4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1654 microversion: 2.1 time: 0.334735 May 31 18:32:10.874863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 330/648] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:10 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1654 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:32:10.877057 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-33be8685-0c9b-433e-9bb2-d1d0c8507c0e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1678 microversion: 2.1 time: 0.341713 May 31 18:32:10.878059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 319/649] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:10 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1678 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:10.891190 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b6dfcdfd-d58f-4cc1-a483-130addce18b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:10.897788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b6dfcdfd-d58f-4cc1-a483-130addce18b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.898346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b6dfcdfd-d58f-4cc1-a483-130addce18b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.915003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:10.921217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b6dfcdfd-d58f-4cc1-a483-130addce18b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Going to try to start instance {{(pid=117589) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 18:32:10.962094 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b6dfcdfd-d58f-4cc1-a483-130addce18b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action" status: 202 len: 0 microversion: 2.1 time: 0.074610 May 31 18:32:10.962685 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 331/650] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:32:10 2022] POST /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:32:10.970665 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:10.971472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:10.980112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.980596 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.981470 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:10.981889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:10.987161 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:11.296247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:11.304331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-58c57331-14f8-4d47-b8fa-b03aa2ed4a03 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1663 microversion: 2.1 time: 0.336842 May 31 18:32:11.304899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 320/651] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:10 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1663 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:11.895580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:11.896492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:11.904149 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:11.904954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:11.905814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:11.906333 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:11.991637 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:11.999719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-070f725e-dd41-4e08-8de8-80fdc66a457e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1611 microversion: 2.1 time: 0.108865 May 31 18:32:12.001271 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 332/652] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:11 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1611 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:12.267597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-8cf0c368-5570-494a-83ed-8648b1cdf915 req-db674de1-d307-494f-851a-372228a177d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdb08f80-5f98-4bb9-a683-73f38dfaeb6d", "name": "network-vif-deleted", "tag": "59b7005a-ed60-4f1b-a721-14607b66ea9f"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:12.276450 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-8cf0c368-5570-494a-83ed-8648b1cdf915 req-db674de1-d307-494f-851a-372228a177d4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:12.276906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-8cf0c368-5570-494a-83ed-8648b1cdf915 req-db674de1-d307-494f-851a-372228a177d4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:12.289219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-8cf0c368-5570-494a-83ed-8648b1cdf915 req-db674de1-d307-494f-851a-372228a177d4 service nova] Creating event network-vif-deleted:59b7005a-ed60-4f1b-a721-14607b66ea9f for instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d on hv-cinder-83979 May 31 18:32:12.294039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-8cf0c368-5570-494a-83ed-8648b1cdf915 req-db674de1-d307-494f-851a-372228a177d4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030084 May 31 18:32:12.294623 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 321/653] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:12.321901 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:12.322395 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:12.328528 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:12.328987 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:12.329791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:12.330434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:12.474624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:12.485346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-fc50564b-a322-4fe9-9379-893d08be0f9a tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1663 microversion: 2.1 time: 0.167450 May 31 18:32:12.486493 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 333/654] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:12 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:13.019554 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:13.020324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:13.027131 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:13.027589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:13.028400 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:13.028837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:13.062280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:13.062728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:13.063189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lazy-loading 'fault' on Instance uuid cdb08f80-5f98-4bb9-a683-73f38dfaeb6d {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:32:13.105957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:13.113803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d57cead9-2fe1-4c4b-8ed7-7c0aa29edb77 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 200 len: 1330 microversion: 2.1 time: 0.099892 May 31 18:32:13.114377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 322/655] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:13 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:13.504118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:13.504846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:13.513651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:13.514102 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:13.514872 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:13.515324 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:13.645055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:13.652574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-12c069c1-882b-48d8-a48b-9fdef9dd8699 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1667 microversion: 2.1 time: 0.152653 May 31 18:32:13.653151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 334/656] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:13 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1667 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:14.131504 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:14.132595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:14.140682 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:14.141130 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:14.141946 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:14.142385 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:14.158606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d HTTP/1.1 May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:32:14.160342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:32:14.161914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'cdb08f80-5f98-4bb9-a683-73f38dfaeb6d'} May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:32:14.163338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:32:14.164870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:14.166157 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:32:14.166157 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-42d12a6f-9a4b-4e06-a4f3-c0c793aa26dd tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 404 len: 111 microversion: 2.1 time: 0.034547 May 31 18:32:14.166329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 323/657] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:14 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:32:14.171412 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-addddff3-d9fe-4a2f-8bcc-0394f35dbf97 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '.version_select at 0x7ffb7418b5e0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:14.189617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-addddff3-d9fe-4a2f-8bcc-0394f35dbf97 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539561395" status: 202 len: 0 microversion: 2.1 time: 0.022011 May 31 18:32:14.190175 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 335/658] 10.222.0.17 () {58 vars in 1217 bytes} [Tue May 31 18:32:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539561395 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:32:14.854209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-657c569f-c130-47ca-95ac-d48618958b6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: .version_select at 0x7ffb74001af0>, body: {"keypair": {"name": "tempest-keypair-1577812958", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+ZnTxiuq+cZc6ikTpV3CACwK+eavJOUwzW9Z5e7lGHs/4AJaDl+oNQTCUHr3SP6mSieY0h3dBANV1GC2ZbUu2hrhmo4r/xYT2FHYNB4DBVQF2otJdP4IBq1ZsOIYMNRQ=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:14.868498 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-657c569f-c130-47ca-95ac-d48618958b6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:32:14.872409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-657c569f-c130-47ca-95ac-d48618958b6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:32:14.894150 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-657c569f-c130-47ca-95ac-d48618958b6e tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043863 May 31 18:32:14.894751 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 324/659] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:32:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:16.198068 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-197548656", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "900f31eb-512c-4a14-a74f-282a3e50261b"}], "security_groups": [{"name": "tempest-securitygroup--1207565211"}], "key_name": "tempest-keypair-1577812958", "user_data": "}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:16.298521 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] validate_networks() for [('900f31eb-512c-4a14-a74f-282a3e50261b', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:32:16.678599 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:32:16.679522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:32:16.679994 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:32:16.680439 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:32:16.680849 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:32:16.689379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:16.689821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:16.690604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:16.691035 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:16.708119 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:32:16.712581 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:32:16.723161 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:32:16.725963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:32:16.776936 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-180dddc7-a977-4263-94f4-9b2eafc92b21 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.583077 May 31 18:32:16.777557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 336/660] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:32:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:32:16.788192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-68226354-5509-4dee-9194-aedfe5d7ee78 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:16.788811 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-68226354-5509-4dee-9194-aedfe5d7ee78 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:16.847119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-68226354-5509-4dee-9194-aedfe5d7ee78 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:16.854082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-68226354-5509-4dee-9194-aedfe5d7ee78 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1241 microversion: 2.1 time: 0.070344 May 31 18:32:16.854640 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 325/661] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:16 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:17.873396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:17.876178 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:17.884202 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:17.884905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:17.885708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:17.886137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:17.956239 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:17.965631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-038a94d4-79bd-48db-b564-70f0ca637f60 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1311 microversion: 2.1 time: 0.097947 May 31 18:32:17.966360 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 337/662] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:17 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:18.982712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:18.983319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:18.989741 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:18.990188 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:18.991707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:18.991919 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:19.212813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:19.226801 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ec6e353d-09ec-412d-ba1f-e30653ba552f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1367 microversion: 2.1 time: 0.247792 May 31 18:32:19.228360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 326/663] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:18 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:19.424492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-544ce0a2-d85b-426e-9074-36915a21570f req-6e9ab54f-6322-412b-bf67-abcb487d8d11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf09a33d-5fae-4b44-929f-9423be34f7c5", "tag": "b0b3e5e9-f455-4a89-8d56-babbf5248d8f"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:19.435099 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-544ce0a2-d85b-426e-9074-36915a21570f req-6e9ab54f-6322-412b-bf67-abcb487d8d11 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:19.436214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-544ce0a2-d85b-426e-9074-36915a21570f req-6e9ab54f-6322-412b-bf67-abcb487d8d11 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:19.460435 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-544ce0a2-d85b-426e-9074-36915a21570f req-6e9ab54f-6322-412b-bf67-abcb487d8d11 service nova] Creating event network-changed:b0b3e5e9-f455-4a89-8d56-babbf5248d8f for instance cf09a33d-5fae-4b44-929f-9423be34f7c5 on hv-cinder-83979 May 31 18:32:19.467059 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-544ce0a2-d85b-426e-9074-36915a21570f req-6e9ab54f-6322-412b-bf67-abcb487d8d11 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046182 May 31 18:32:19.470744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 338/664] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:20.245085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:20.245686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:20.252398 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:20.252839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:20.253587 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:20.254019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:20.388480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:20.395743 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-511c961b-58c3-4ce4-a45b-bd1f4a9d9bae tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1367 microversion: 2.1 time: 0.155356 May 31 18:32:20.396327 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 327/665] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:20 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:21.414468 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:21.415207 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:21.421364 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:21.421821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:21.422620 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:21.423064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:21.554208 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:21.561458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6cf3aa18-d261-4caf-a8c7-79e4c29ec6a9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1367 microversion: 2.1 time: 0.152559 May 31 18:32:21.562012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 339/666] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:21 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:22.578870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:22.579493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:22.586491 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:22.587017 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:22.587856 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:22.588393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:22.797781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:22.805281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-eaedb9c1-df27-4d47-acb5-d1d9a3efb1cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1367 microversion: 2.1 time: 0.230375 May 31 18:32:22.805839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 328/667] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:22 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:23.768910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-167a3489-ce59-4dcb-9867-56a745851415 req-73a3fbbc-385c-438c-bf1a-e65057389b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf09a33d-5fae-4b44-929f-9423be34f7c5", "name": "network-vif-plugged", "status": "completed", "tag": "b0b3e5e9-f455-4a89-8d56-babbf5248d8f"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:23.777441 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-167a3489-ce59-4dcb-9867-56a745851415 req-73a3fbbc-385c-438c-bf1a-e65057389b91 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:23.777888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-167a3489-ce59-4dcb-9867-56a745851415 req-73a3fbbc-385c-438c-bf1a-e65057389b91 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:23.789425 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-167a3489-ce59-4dcb-9867-56a745851415 req-73a3fbbc-385c-438c-bf1a-e65057389b91 service nova] Creating event network-vif-plugged:b0b3e5e9-f455-4a89-8d56-babbf5248d8f for instance cf09a33d-5fae-4b44-929f-9423be34f7c5 on hv-cinder-83979 May 31 18:32:23.794579 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-167a3489-ce59-4dcb-9867-56a745851415 req-73a3fbbc-385c-438c-bf1a-e65057389b91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029339 May 31 18:32:23.795164 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 340/668] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:23.820922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:23.821538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:23.828046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:23.828520 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:23.829286 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:23.829723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:23.993176 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:24.000908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a4a11efa-b2c0-4e0c-9246-297da03074d2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1367 microversion: 2.1 time: 0.183698 May 31 18:32:24.001559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 329/669] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:23 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:25.018911 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:25.019638 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:25.026169 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:25.026610 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:25.027363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:25.027875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:25.160586 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:25.168023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3683dcfb-c2c6-4756-9404-a90d0c1be38a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1367 microversion: 2.1 time: 0.153776 May 31 18:32:25.168620 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 341/670] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:25 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:26.185179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:26.185796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:26.192232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:26.192686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:26.193448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:26.193879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:26.319951 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:26.327380 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c96fbf88-96ff-4a29-9662-1971e7432f62 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1556 microversion: 2.1 time: 0.146281 May 31 18:32:26.327932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 330/671] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:26 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1556 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:26.343452 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:26.343949 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:26.351229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:26.351672 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:26.352463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:26.352902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:26.428447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-de60dcbb-36c5-4b23-a7ac-11772b9ac017 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088172 May 31 18:32:26.429107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 342/672] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:32:26 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:27.647964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-f0640457-b33b-4fe3-9f0e-cbbbfefc0824 req-56d92ea7-25b5-4723-9306-dea3ac86c387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf09a33d-5fae-4b44-929f-9423be34f7c5", "tag": "b0b3e5e9-f455-4a89-8d56-babbf5248d8f"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:27.651513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:27.657769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-f0640457-b33b-4fe3-9f0e-cbbbfefc0824 req-56d92ea7-25b5-4723-9306-dea3ac86c387 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:27.658212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-f0640457-b33b-4fe3-9f0e-cbbbfefc0824 req-56d92ea7-25b5-4723-9306-dea3ac86c387 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:27.668980 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-f0640457-b33b-4fe3-9f0e-cbbbfefc0824 req-56d92ea7-25b5-4723-9306-dea3ac86c387 service nova] Creating event network-changed:b0b3e5e9-f455-4a89-8d56-babbf5248d8f for instance cf09a33d-5fae-4b44-929f-9423be34f7c5 on hv-cinder-83979 May 31 18:32:27.673967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-f0640457-b33b-4fe3-9f0e-cbbbfefc0824 req-56d92ea7-25b5-4723-9306-dea3ac86c387 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030504 May 31 18:32:27.674560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 331/673] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:32:44.478165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:44.478985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=6 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:44.480324 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:44.481045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:44.485820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:44.486305 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:44.495325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:44.495767 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:44.496548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:44.496983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:44.577299 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lazy-loading 'services' on Instance uuid 549e1c59-1ba0-4754-b95c-49ac8e3cc547 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:32:44.650140 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0c53ca45-4b2a-45dc-af2a-600971abdbbe tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments/93898d3a-3afa-46c0-8f1c-d06de0140eff" status: 202 len: 0 microversion: 2.1 time: 0.172549 May 31 18:32:44.650708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 343/674] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:32:44 2022] DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments/93898d3a-3afa-46c0-8f1c-d06de0140eff => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:32:44.656928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:44.658174 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=48 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:32:44.663247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:44.664285 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:44.672406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:44.672849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:44.673623 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:44.674059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:44.704892 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-98959066-934d-43bc-8f7b-3f7e635b7781 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049563 May 31 18:32:44.705353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 332/675] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:32:44 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:45.719169 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:45.720319 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:45.727585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:45.728038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:45.728841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:45.729275 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:45.759812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d757b8e8-a22b-4504-8313-718945b55627 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045698 May 31 18:32:45.760404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 344/676] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:32:45 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:32:45.834768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:45.835316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:45.841758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:45.842209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:45.842969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:45.843408 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:45.869324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:32:45.943595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1b4df565-c60e-4d87-b751-a21bfaa4feca tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 204 len: 0 microversion: 2.1 time: 0.112368 May 31 18:32:45.944260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 333/677] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:32:45 2022] DELETE /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:32:45.952894 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:45.953532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:45.959967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:45.960454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:45.961203 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:45.961631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:46.091727 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:46.099013 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9b2a858a-a278-489b-9df4-00ed1c7c0490 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1687 microversion: 2.1 time: 0.150395 May 31 18:32:46.100354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 345/678] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:45 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1687 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:47.117222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:47.117866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:47.124319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:47.124842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:47.125582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:47.126262 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:47.263268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:47.270734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1b3ee0cb-6efc-4449-b257-2be38d1f8334 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1687 microversion: 2.1 time: 0.157949 May 31 18:32:47.271832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 334/679] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:47 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:48.288782 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:48.289433 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:48.295887 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:48.296363 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:48.297176 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:48.297619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:48.425250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:48.432746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c66282c0-4484-4533-85fd-2d446aadd915 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1687 microversion: 2.1 time: 0.148549 May 31 18:32:48.433307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 346/680] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:48 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1687 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:49.449729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:49.450342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:49.456733 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:49.457176 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:49.457929 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:49.458360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:49.591619 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:49.599543 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-67f625e7-0dc7-493b-bb5b-fc24da738d44 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1687 microversion: 2.1 time: 0.153188 May 31 18:32:49.600253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 335/681] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:49 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:50.616479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:50.617097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:50.623494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:50.623945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:50.624738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:50.625180 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:50.698509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:50.705949 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-15e974c1-8b7b-4190-946e-a48435dceafc tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 200 len: 1620 microversion: 2.1 time: 0.093894 May 31 18:32:50.706521 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 347/682] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:50 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 1620 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:50.811469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-b3d5bca4-31ed-497f-832a-f1ecb718f95d req-6daad429-0504-43b5-94fb-65e723dd393d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "549e1c59-1ba0-4754-b95c-49ac8e3cc547", "name": "network-vif-deleted", "tag": "301a1ec7-72c4-46e8-b9de-f5e5d1d3e419"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:50.820226 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-b3d5bca4-31ed-497f-832a-f1ecb718f95d req-6daad429-0504-43b5-94fb-65e723dd393d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:50.820969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-b3d5bca4-31ed-497f-832a-f1ecb718f95d req-6daad429-0504-43b5-94fb-65e723dd393d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:50.833551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-b3d5bca4-31ed-497f-832a-f1ecb718f95d req-6daad429-0504-43b5-94fb-65e723dd393d service nova] Creating event network-vif-deleted:301a1ec7-72c4-46e8-b9de-f5e5d1d3e419 for instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 on hv-cinder-83979 May 31 18:32:50.838624 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-b3d5bca4-31ed-497f-832a-f1ecb718f95d req-6daad429-0504-43b5-94fb-65e723dd393d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031939 May 31 18:32:50.839287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 336/683] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:51.723088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:51.723645 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: 549e1c59-1ba0-4754-b95c-49ac8e3cc547] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:51.730277 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:51.730728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:51.731495 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:51.731931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:51.745733 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] HTTP exception thrown: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 could not be found. May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Request method failure captured: May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 HTTP/1.1 May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill2DZNbmBXSE1I6kZ6AxRSxP2cDbzLVsV8TkpYhf1AGgVyAxGU-dYUYfqXrWp73VKewLownXsTqqprgnTVpT5bmpXn4Yg3dTHk29KSfNUiXM4CPdusn54OtbSKNMsuyT_sOAhFIBv19P3h78udqSVHQfF5fbnbQNMFtxAlwazeE_U24 May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 2628eee87b7147b8866790922d57222c May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:32:51.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2628eee87b7147b8866790922d57222c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2628eee87b7147b8866790922d57222c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 2628eee87b7147b8866790922d57222c May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 39fdc2681def478990bb4b78de5d34ee May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 could not be found. May 31 18:32:51.749058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '549e1c59-1ba0-4754-b95c-49ac8e3cc547'} May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 could not be found. May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:32:51.751540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 could not be found. May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 could not be found. May 31 18:32:51.753641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:51.754939 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Returning 404 to user: Instance 549e1c59-1ba0-4754-b95c-49ac8e3cc547 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:32:51.754939 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-37b61ef2-b424-4c89-a700-91518760d1ff tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547" status: 404 len: 111 microversion: 2.1 time: 0.029897 May 31 18:32:51.754939 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 348/684] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:51 2022] GET /compute/v2.1/servers/549e1c59-1ba0-4754-b95c-49ac8e3cc547 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:32:51.761588 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-051ee6be-2cea-41fc-9792-5554894aee23 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '.version_select at 0x7ffb6efec280>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:51.781842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-051ee6be-2cea-41fc-9792-5554894aee23 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-422438831" status: 202 len: 0 microversion: 2.1 time: 0.024364 May 31 18:32:51.782420 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 337/685] 10.222.0.17 () {58 vars in 1217 bytes} [Tue May 31 18:32:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-422438831 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:32:54.646532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:54.647208 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:54.653829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:54.654279 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:54.655042 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:54.655478 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:54.681476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:32:54.757779 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ecc47081-2fd7-4f2b-ae68-b1ab37753291 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 204 len: 0 microversion: 2.1 time: 0.114857 May 31 18:32:54.758789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 349/686] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:32:54 2022] DELETE /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:32:54.766747 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:54.767479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:54.774321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:54.774773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:54.775532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:54.775967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:54.914096 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:54.921489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-771ac9bc-4b18-4c09-926d-82b5996fb835 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1507 microversion: 2.1 time: 0.158638 May 31 18:32:54.922044 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 338/687] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:54 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:55.939071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:55.939714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:55.946663 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:55.947107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:55.947873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:55.948362 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:56.037415 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:56.045282 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-836d4c02-e8ed-4110-a0c1-ed7df2db7ddb tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 200 len: 1465 microversion: 2.1 time: 0.110476 May 31 18:32:56.046531 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 350/688] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:55 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 1465 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:56.070972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-7b566ea4-a9c2-4da4-b1a5-eb8cb26c467a req-df8a2cec-af57-418a-bf9b-3682e766caac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b68923-c8a5-4442-ad4d-4250c59297bd", "name": "network-vif-deleted", "tag": "325d684d-e848-4a76-80a9-5caebe89e3ae"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:56.080649 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-7b566ea4-a9c2-4da4-b1a5-eb8cb26c467a req-df8a2cec-af57-418a-bf9b-3682e766caac service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:56.081203 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-7b566ea4-a9c2-4da4-b1a5-eb8cb26c467a req-df8a2cec-af57-418a-bf9b-3682e766caac service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:56.095204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-7b566ea4-a9c2-4da4-b1a5-eb8cb26c467a req-df8a2cec-af57-418a-bf9b-3682e766caac service nova] Creating event network-vif-deleted:325d684d-e848-4a76-80a9-5caebe89e3ae for instance b4b68923-c8a5-4442-ad4d-4250c59297bd on hv-cinder-83979 May 31 18:32:56.102277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-7b566ea4-a9c2-4da4-b1a5-eb8cb26c467a req-df8a2cec-af57-418a-bf9b-3682e766caac service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036409 May 31 18:32:56.102962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 339/689] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:57.062623 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:57.063234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: b4b68923-c8a5-4442-ad4d-4250c59297bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:57.070463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:57.070943 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:57.071705 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:57.072167 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:57.087971 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] HTTP exception thrown: Instance b4b68923-c8a5-4442-ad4d-4250c59297bd could not be found. May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Request method failure captured: May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd HTTP/1.1 May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill2DZNbmBXSE1I6kZ6AxRSxP2cDbzLVsV8TkpYhf1AGgVyAxGU-dYUYfqXrWp73VKewLownXsTqqprgnTVpT5bmpXn4Yg3dTHk29KSfNUiXM4CPdusn54OtbSKNMsuyT_sOAhFIBv19P3h78udqSVHQfF5fbnbQNMFtxAlwazeE_U24 May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 2628eee87b7147b8866790922d57222c May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:32:57.089630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2628eee87b7147b8866790922d57222c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2628eee87b7147b8866790922d57222c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 2628eee87b7147b8866790922d57222c May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 39fdc2681def478990bb4b78de5d34ee May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance b4b68923-c8a5-4442-ad4d-4250c59297bd could not be found. May 31 18:32:57.091491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'b4b68923-c8a5-4442-ad4d-4250c59297bd'} May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b68923-c8a5-4442-ad4d-4250c59297bd could not be found. May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:32:57.092624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b68923-c8a5-4442-ad4d-4250c59297bd could not be found. May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b68923-c8a5-4442-ad4d-4250c59297bd could not be found. May 31 18:32:57.093967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:32:57.095303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Returning 404 to user: Instance b4b68923-c8a5-4442-ad4d-4250c59297bd could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:32:57.095303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c84a7f4b-4719-4e05-8fe8-872cb4c7da15 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd" status: 404 len: 111 microversion: 2.1 time: 0.032243 May 31 18:32:57.095303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 351/690] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:57 2022] GET /compute/v2.1/servers/b4b68923-c8a5-4442-ad4d-4250c59297bd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:32:57.100749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:57.101330 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:57.107852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:57.108332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:57.109088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:57.109522 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:57.136129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:32:57.207191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-090f7db6-cf99-45c6-9ba8-06c541d7f33d tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "DELETE /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 204 len: 0 microversion: 2.1 time: 0.110615 May 31 18:32:57.207785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 340/691] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:32:57 2022] DELETE /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 18:32:57.216173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:57.216780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:57.222708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:57.223155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:57.223910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:57.224587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:57.353660 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:57.362091 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f6afc86a-e230-4fd9-a59a-15a398183568 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1520 microversion: 2.1 time: 0.149820 May 31 18:32:57.362684 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 352/692] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:57 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:58.381436 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:58.382660 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:58.389645 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:58.390101 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:58.390870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:58.391307 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:58.485106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fdc2681def478990bb4b78de5d34ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2628eee87b7147b8866790922d57222c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:32:58.494403 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-153dfa18-8a4b-43e0-92e4-d50d5e67dda4 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 200 len: 1478 microversion: 2.1 time: 0.118004 May 31 18:32:58.495292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 341/693] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:58 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 1478 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:32:58.497203 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-8cd1f9ff-c56a-4fb1-b6f9-480844d06bf8 req-70d418e4-f67a-4c29-9560-d7a52c970528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf24b7e-be1e-4235-a568-b5679595a5bd", "name": "network-vif-deleted", "tag": "90e3439b-12bb-4408-80c9-2545132e076f"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:32:58.508187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-8cd1f9ff-c56a-4fb1-b6f9-480844d06bf8 req-70d418e4-f67a-4c29-9560-d7a52c970528 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:58.508722 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-8cd1f9ff-c56a-4fb1-b6f9-480844d06bf8 req-70d418e4-f67a-4c29-9560-d7a52c970528 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:58.521015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-8cd1f9ff-c56a-4fb1-b6f9-480844d06bf8 req-70d418e4-f67a-4c29-9560-d7a52c970528 service nova] Creating event network-vif-deleted:90e3439b-12bb-4408-80c9-2545132e076f for instance abf24b7e-be1e-4235-a568-b5679595a5bd on hv-cinder-83979 May 31 18:32:58.527146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-8cd1f9ff-c56a-4fb1-b6f9-480844d06bf8 req-70d418e4-f67a-4c29-9560-d7a52c970528 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033414 May 31 18:32:58.528070 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 353/694] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:32:59.512166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:32:59.512794 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] [instance: abf24b7e-be1e-4235-a568-b5679595a5bd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:32:59.519228 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:59.519678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:59.520471 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:32:59.520936 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:32:59.533835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] HTTP exception thrown: Instance abf24b7e-be1e-4235-a568-b5679595a5bd could not be found. May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Request method failure captured: May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd HTTP/1.1 May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill2DZNbmBXSE1I6kZ6AxRSxP2cDbzLVsV8TkpYhf1AGgVyAxGU-dYUYfqXrWp73VKewLownXsTqqprgnTVpT5bmpXn4Yg3dTHk29KSfNUiXM4CPdusn54OtbSKNMsuyT_sOAhFIBv19P3h78udqSVHQfF5fbnbQNMFtxAlwazeE_U24 May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 2628eee87b7147b8866790922d57222c May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:32:59.535448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_2628eee87b7147b8866790922d57222c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/2628eee87b7147b8866790922d57222c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/2628eee87b7147b8866790922d57222c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 2628eee87b7147b8866790922d57222c May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1145872057 May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 39fdc2681def478990bb4b78de5d34ee May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1145872057-project May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance abf24b7e-be1e-4235-a568-b5679595a5bd could not be found. May 31 18:32:59.537124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'abf24b7e-be1e-4235-a568-b5679595a5bd'} May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf24b7e-be1e-4235-a568-b5679595a5bd could not be found. May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:32:59.538074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf24b7e-be1e-4235-a568-b5679595a5bd could not be found. May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf24b7e-be1e-4235-a568-b5679595a5bd could not be found. May 31 18:32:59.539444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:32:59.540719 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] Returning 404 to user: Instance abf24b7e-be1e-4235-a568-b5679595a5bd could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:32:59.540719 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bec05f7f-2c5f-42a6-b77f-d112a0bea9e9 tempest-ServerRescueNegativeTestJSON-1145872057 tempest-ServerRescueNegativeTestJSON-1145872057-project] 10.222.0.17 "GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd" status: 404 len: 111 microversion: 2.1 time: 0.028727 May 31 18:32:59.540719 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 342/695] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:32:59 2022] GET /compute/v2.1/servers/abf24b7e-be1e-4235-a568-b5679595a5bd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:33:08.321506 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e080aa29-9074-49a8-90f8-d065bf8360c1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'create', calling method: .version_select at 0x7ffb78a808b0>, body: {"keypair": {"name": "tempest-keypair-1860443877", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqoU/H9N4FwsjN/QSy0M7l4JqN4KlCr5uf1gCuPjXIo8UlAkVdsq1n3G7Ta96nxiwzOAnn74FHHOa6ylXihzIz5FV+7m3+0Y5ettchgmGCEVG3EpXH+qnyxSMRfoV0feg=="}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:08.335764 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-e080aa29-9074-49a8-90f8-d065bf8360c1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:33:08.340003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-e080aa29-9074-49a8-90f8-d065bf8360c1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for user eae1472e93fd44d5a621e03f2f2e8476 and project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:33:08.363120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e080aa29-9074-49a8-90f8-d065bf8360c1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.163517 May 31 18:33:08.363720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 354/696] 10.222.0.17 () {62 vars in 1199 bytes} [Tue May 31 18:33:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 31 18:33:09.679036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1514815772", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "575d4a63-fb04-4ed5-a3bf-841d4712605f"}], "security_groups": [{"name": "tempest-securitygroup--595863242"}], "key_name": "tempest-keypair-1860443877", "user_data": "}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:09.686323 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:09.686975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:09.787616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] validate_networks() for [('575d4a63-fb04-4ed5-a3bf-841d4712605f', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:33:10.218497 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:33:10.219117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:33:10.219626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:33:10.220337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:33:10.220751 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:33:10.230821 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:10.231356 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:10.232194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:10.232622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:10.252032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:33:10.258503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for user eae1472e93fd44d5a621e03f2f2e8476 and project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:33:10.271274 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:33:10.273613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:33:10.334199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fde35a35-b639-438c-a026-c02c840298c0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.660481 May 31 18:33:10.340550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 343/697] 10.222.0.17 () {62 vars in 1187 bytes} [Tue May 31 18:33:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 31 18:33:10.343260 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=65,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:10.347260 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-742de582-5038-4361-8da7-690db48e5f5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:10.347945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-742de582-5038-4361-8da7-690db48e5f5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:10.425660 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-742de582-5038-4361-8da7-690db48e5f5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:10.435789 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-742de582-5038-4361-8da7-690db48e5f5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:10.437339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-742de582-5038-4361-8da7-690db48e5f5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:10.438462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-742de582-5038-4361-8da7-690db48e5f5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1282 microversion: 2.20 time: 0.096671 May 31 18:33:10.439000 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 355/698] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:10 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1282 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:33:11.458650 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cd70f517-a72b-4c5a-84f2-35fbb1cdd8bb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:11.459349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cd70f517-a72b-4c5a-84f2-35fbb1cdd8bb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:11.518589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cd70f517-a72b-4c5a-84f2-35fbb1cdd8bb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:11.526261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cd70f517-a72b-4c5a-84f2-35fbb1cdd8bb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:11.527764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cd70f517-a72b-4c5a-84f2-35fbb1cdd8bb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:11.528948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cd70f517-a72b-4c5a-84f2-35fbb1cdd8bb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1282 microversion: 2.20 time: 0.075069 May 31 18:33:11.529508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 344/699] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:11 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1282 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:12.547030 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cef14271-5700-4c2e-be0f-6a4fcad8260d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:12.547642 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cef14271-5700-4c2e-be0f-6a4fcad8260d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:12.603290 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cef14271-5700-4c2e-be0f-6a4fcad8260d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:12.610622 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cef14271-5700-4c2e-be0f-6a4fcad8260d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:12.612172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cef14271-5700-4c2e-be0f-6a4fcad8260d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:12.613281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cef14271-5700-4c2e-be0f-6a4fcad8260d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1282 microversion: 2.20 time: 0.070080 May 31 18:33:12.614164 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 356/700] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:12 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1282 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:13.637439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-47329f5f-0004-4f04-9c4e-b412b21489ee tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:13.638088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-47329f5f-0004-4f04-9c4e-b412b21489ee tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:13.697223 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-47329f5f-0004-4f04-9c4e-b412b21489ee tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:13.704467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-47329f5f-0004-4f04-9c4e-b412b21489ee tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:13.706222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-47329f5f-0004-4f04-9c4e-b412b21489ee tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:13.707321 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-47329f5f-0004-4f04-9c4e-b412b21489ee tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1282 microversion: 2.20 time: 0.074469 May 31 18:33:13.707869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 345/701] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:13 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:14.727109 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:14.727719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:14.729955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:14.736022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:14.736499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:14.737261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:14.737699 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:14.799030 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:14.807686 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:14.809214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:14.810304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aa22a578-0874-4b20-a26d-4bebfc3bbce9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1286 microversion: 2.20 time: 0.087319 May 31 18:33:14.810851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 357/702] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:14 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:15.828393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:15.829000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:15.836914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:15.837360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:15.838123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:15.838663 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:15.909503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:15.918306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:15.919817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:15.920944 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-55f65280-534f-4c10-8529-4d83ed1d71d6 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1340 microversion: 2.20 time: 0.096631 May 31 18:33:15.921531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 346/703] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:15 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:16.846945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:16.847949 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:16.855158 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:16.855678 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:16.856548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:16.857056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:16.888933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-55b84a5e-2692-4460-9ec8-6797645a1dc1 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045841 May 31 18:33:16.889520 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 358/704] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:33:16 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:33:16.941296 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:16.943500 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:16.951640 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:16.952327 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:16.953293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:16.954046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:16.955470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:16.955972 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:16.965081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:16.966091 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:16.967281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:16.967921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:16.995735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:33:17.086972 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e42a8559-3ac6-4a6e-823f-4e6e9529ee7e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 204 len: 0 microversion: 2.1 time: 0.134779 May 31 18:33:17.089278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 359/705] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:33:16 2022] DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:33:17.097727 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:17.099719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:17.105532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:17.105985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:17.107065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:17.107267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:17.200855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:17.210481 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:17.212419 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:17.214450 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d91aae74-1583-4bd8-bfdf-64a1b88b1de0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.277460 May 31 18:33:17.215019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 347/706] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:16 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:33:17.326818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:17.336180 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f65fef4d-c149-4462-bdb9-c792cdaea2b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1673 microversion: 2.1 time: 0.242604 May 31 18:33:17.345429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 360/707] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:17 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:17.377910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-1e38a27a-0750-406e-b072-130ca9c1df62 req-46d64fff-99b0-453c-ae70-8b39835d49d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:17.387979 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-1e38a27a-0750-406e-b072-130ca9c1df62 req-46d64fff-99b0-453c-ae70-8b39835d49d3 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:17.388527 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-1e38a27a-0750-406e-b072-130ca9c1df62 req-46d64fff-99b0-453c-ae70-8b39835d49d3 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:17.406397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-1e38a27a-0750-406e-b072-130ca9c1df62 req-46d64fff-99b0-453c-ae70-8b39835d49d3 service nova] Creating event network-changed:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:33:17.412436 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-1e38a27a-0750-406e-b072-130ca9c1df62 req-46d64fff-99b0-453c-ae70-8b39835d49d3 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039055 May 31 18:33:17.413062 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 348/708] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:18.233054 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:18.233666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:18.241284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:18.241734 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:18.242524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:18.242962 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:18.354032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:18.354722 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:18.360803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:18.361248 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:18.362000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:18.362429 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:18.399889 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:18.409646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:18.409891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:18.410982 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d659b07f-cca6-4ef0-9ca6-d3b168ee9dad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.181894 May 31 18:33:18.411669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 361/709] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:18 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:18.658737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:18.666872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-22498210-a8b3-4811-8bfc-c25e88bc7470 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1673 microversion: 2.1 time: 0.317881 May 31 18:33:18.667527 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 349/710] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:18 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1673 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:19.431071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:19.431654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:19.438444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:19.438888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:19.439653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:19.440243 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:19.655893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:19.664447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:19.665985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:19.667126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aef3d51c-4db9-4784-b659-5adaa88857b2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.242179 May 31 18:33:19.667677 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 362/711] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:19 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:19.684148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:19.684703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:19.691158 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:19.691613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:19.692412 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:19.692968 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:19.778075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:19.791869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-85ca8484-f101-4dff-ad43-7b7942d36cf4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1605 microversion: 2.1 time: 0.111575 May 31 18:33:19.792785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 350/712] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:19 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1605 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:19.797631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-add86f45-06d6-48d3-893d-91e6a45ee56a req-1b023f70-726b-4240-b797-5e864cdcae91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad9cc87a-c08b-48eb-9014-e1a997cd84d7", "name": "network-vif-deleted", "tag": "c06d263b-c5ec-4362-8ed7-8fe070f4b8e9"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:19.806399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-add86f45-06d6-48d3-893d-91e6a45ee56a req-1b023f70-726b-4240-b797-5e864cdcae91 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:19.806835 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-add86f45-06d6-48d3-893d-91e6a45ee56a req-1b023f70-726b-4240-b797-5e864cdcae91 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:19.818324 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-add86f45-06d6-48d3-893d-91e6a45ee56a req-1b023f70-726b-4240-b797-5e864cdcae91 service nova] Creating event network-vif-deleted:c06d263b-c5ec-4362-8ed7-8fe070f4b8e9 for instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 on hv-cinder-83979 May 31 18:33:19.823327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-add86f45-06d6-48d3-893d-91e6a45ee56a req-1b023f70-726b-4240-b797-5e864cdcae91 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 May 31 18:33:19.823917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 363/713] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:33:20.684230 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:20.684835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:20.686779 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:20.692539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:20.693532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:20.694556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:20.694991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:20.810340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:20.811253 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:20.817466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:20.818027 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:20.818952 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:20.819462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:20.837340 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:20.845346 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:20.846857 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:20.848038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ac24c6fb-f347-4fbb-8160-e2b5a9c42d3f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.167712 May 31 18:33:20.848616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 351/714] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:20 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:20.882669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:20.890120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a98963a0-6284-439a-a5fa-365e8caf3cdd tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1605 microversion: 2.1 time: 0.084538 May 31 18:33:20.890686 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 364/715] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:20 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1605 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:21.866696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:21.867329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:21.873659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:21.874100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:21.874849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:21.875279 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:21.908018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:21.908669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:21.915172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:21.915625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:21.916455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:21.916894 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:21.952924 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:21.953453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:21.954058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lazy-loading 'fault' on Instance uuid ad9cc87a-c08b-48eb-9014-e1a997cd84d7 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:33:22.007101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:22.015431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0d0116e5-6976-4782-b529-7bb74a0b14af tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 200 len: 1326 microversion: 2.1 time: 0.111375 May 31 18:33:22.016696 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 365/716] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:21 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:22.041978 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:22.050018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:22.051573 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:22.053542 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cef5738d-20bb-44af-b9d9-bfbd73473521 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.191036 May 31 18:33:22.054191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 352/717] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:21 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:23.032951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:23.033552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:23.035444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=8 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:23.042797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:23.043241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:23.044003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:23.044462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:23.058811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] HTTP exception thrown: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Request method failure captured: May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 HTTP/1.1 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16wEZ3LsqX3zhvChS-LwShZyC_XbOelHhICwKNldMUvXdJqOGRhszIp3gMwUbiufsGnFUHzZlUXhdk72Cs38TKZ4HtG1-PmvLOjcHiTZXkzNfI1F9TCeiyT0FuhbtiNutrFA3Eas1pC3KjObKc9TQwZbeTTOdzxVycz3JED4Ct-r8 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:33:23.060448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea083067dfc4b6194457652a3501317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea083067dfc4b6194457652a3501317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeTestJSON-480748412 May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeTestJSON-480748412-project May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 7c6d1ac15d024f77bb363170ab423c0b May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeTestJSON-480748412-project May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:33:23.062022 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'ad9cc87a-c08b-48eb-9014-e1a997cd84d7'} May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:33:23.062937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:33:23.064504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:23.065991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Returning 404 to user: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:33:23.065991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8c076299-00d6-4e69-9769-90ee34ea1263 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 404 len: 111 microversion: 2.1 time: 0.032749 May 31 18:33:23.065991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 366/718] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:23 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:33:23.071290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3d125927-2c48-4d16-a9c2-6e81d153f194 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '.version_select at 0x7ffb741694c0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:23.071778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:23.072038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:23.078000 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:23.078453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:23.079215 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:23.079648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:23.089787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3d125927-2c48-4d16-a9c2-6e81d153f194 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-67692383" status: 202 len: 0 microversion: 2.1 time: 0.022607 May 31 18:33:23.090567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 353/719] 10.222.0.17 () {58 vars in 1214 bytes} [Tue May 31 18:33:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-67692383 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:33:23.212822 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:23.220675 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:23.222185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:23.223294 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-730e0a8a-e00b-4448-982a-c758cf75492b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.155643 May 31 18:33:23.224393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 367/720] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:23 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:33:23.720955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b47b6992-053e-4c10-8591-44970c8784e4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: .version_select at 0x7ffb740ac160>, body: {"keypair": {"name": "tempest-keypair-1871324145", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJNnc3ruguGlKzW9em/Z4CdF2x9NrPPdOiCGOTdh41LU9duXzwaq/CFZxecgGHQXLwzrJOsU794f0V3s3wDTtcgzw7Qux3R5BUINJKflF2aPBLq4cQpCOWAlVdZYpN13g=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:23.726134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=10 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:23.739159 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-b47b6992-053e-4c10-8591-44970c8784e4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for project 7ea083067dfc4b6194457652a3501317. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:33:23.742936 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-b47b6992-053e-4c10-8591-44970c8784e4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for user 7c6d1ac15d024f77bb363170ab423c0b and project 7ea083067dfc4b6194457652a3501317. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:33:23.765200 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b47b6992-053e-4c10-8591-44970c8784e4 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048132 May 31 18:33:23.765782 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 354/721] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:33:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:24.244284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:24.245061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:24.251837 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:24.252787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:24.253566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:24.254006 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:24.470964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:24.480011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:24.481690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:24.482830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6746e1ef-b4f5-4f15-b0c9-06a0c9f945c7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.243856 May 31 18:33:24.483377 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 368/722] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:24 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:25.152871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1896268118", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2863d12-f128-4cc6-8ca8-950d8f1eec2e"}], "security_groups": [{"name": "tempest-securitygroup--1101206996"}], "key_name": "tempest-keypair-1871324145", "user_data": "}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:25.250760 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] validate_networks() for [('f2863d12-f128-4cc6-8ca8-950d8f1eec2e', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:33:25.501219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:25.501927 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:25.509498 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:25.509958 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:25.510896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:25.511339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:25.672374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:33:25.672795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:33:25.673270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:33:25.673672 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:33:25.674074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:33:25.683734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:25.684215 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:25.685016 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:25.685453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:25.699631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:25.702903 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for project 7ea083067dfc4b6194457652a3501317. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:33:25.706828 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Getting quotas for user 7c6d1ac15d024f77bb363170ab423c0b and project 7ea083067dfc4b6194457652a3501317. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:33:25.707930 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:25.709704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:25.710809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6394a98d-fae9-4870-be48-ad9d4bcee30e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.213461 May 31 18:33:25.711368 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 369/723] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:25 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:33:25.717983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:33:25.720268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:33:25.766804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3c14b700-b749-40e0-8e6e-2d6299143ee8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.618721 May 31 18:33:25.767437 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 355/724] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:33:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:33:25.777587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d4268d6d-1d46-4f43-8a05-d041ad0b0f3f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:25.778197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d4268d6d-1d46-4f43-8a05-d041ad0b0f3f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:25.836709 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d4268d6d-1d46-4f43-8a05-d041ad0b0f3f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:25.845573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d4268d6d-1d46-4f43-8a05-d041ad0b0f3f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1238 microversion: 2.1 time: 0.071687 May 31 18:33:25.846143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 370/725] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:25 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1238 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:26.220698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-a131638f-fefa-458f-86c0-c39174c32d0a req-21c91968-8e6e-49df-b5d0-3647754bae82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "name": "network-vif-plugged", "status": "completed", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:26.231047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a131638f-fefa-458f-86c0-c39174c32d0a req-21c91968-8e6e-49df-b5d0-3647754bae82 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:26.231642 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-a131638f-fefa-458f-86c0-c39174c32d0a req-21c91968-8e6e-49df-b5d0-3647754bae82 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:26.245275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-a131638f-fefa-458f-86c0-c39174c32d0a req-21c91968-8e6e-49df-b5d0-3647754bae82 service nova] Creating event network-vif-plugged:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:33:26.250330 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-a131638f-fefa-458f-86c0-c39174c32d0a req-21c91968-8e6e-49df-b5d0-3647754bae82 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 May 31 18:33:26.251122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 356/726] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:26.729857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:26.730465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:26.738607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:26.739156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:26.740322 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:26.740767 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:26.862974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:26.863679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:26.870294 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:26.870750 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:26.871528 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:26.871971 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:26.874328 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:26.883168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:26.884738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:26.885843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-57caa706-e3d1-4bdc-a0f9-18b28b16e333 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.159889 May 31 18:33:26.886390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 371/727] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:26 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:26.938777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:26.946950 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-65094cf3-51ab-482a-87da-48ab44511a7d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1298 microversion: 2.1 time: 0.088186 May 31 18:33:26.947506 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 357/728] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:26 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:27.911575 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:27.913123 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:27.919952 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:27.920442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:27.921215 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:27.921661 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:27.964866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:27.965501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:27.972037 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:27.972591 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:27.973454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:27.973954 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:28.060372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:28.068386 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c04a9e67-13ec-4db5-a558-f49aa287dc1c tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1296 microversion: 2.1 time: 0.107396 May 31 18:33:28.069058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 358/729] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:27 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1296 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:28.164343 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:28.172147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:28.173651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:28.174755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6c36efc2-fbc1-4973-a9dd-0d80cf06f60f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1407 microversion: 2.20 time: 0.274441 May 31 18:33:28.175308 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 372/730] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:27 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1407 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:33:29.086617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:29.087381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:29.095423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.095868 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.096668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.097100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.192893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:29.193757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:29.200561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.201011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.201787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.202222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.408646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:29.416653 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d1b91102-15cb-414d-a738-f6dab977d10e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.335078 May 31 18:33:29.417225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 359/731] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:29 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:29.421827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-191473e6-508b-486c-8e79-a0a984df9318 req-2376155d-3b53-44a2-bfbb-3b4a88343298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10c2fd8-42b0-446b-b4b6-27225c87e822", "tag": "2dd8b304-ffcc-4998-aac2-e47690d5ad71"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:29.430293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-191473e6-508b-486c-8e79-a0a984df9318 req-2376155d-3b53-44a2-bfbb-3b4a88343298 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.430735 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-191473e6-508b-486c-8e79-a0a984df9318 req-2376155d-3b53-44a2-bfbb-3b4a88343298 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.441340 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-191473e6-508b-486c-8e79-a0a984df9318 req-2376155d-3b53-44a2-bfbb-3b4a88343298 service nova] Creating event network-changed:2dd8b304-ffcc-4998-aac2-e47690d5ad71 for instance f10c2fd8-42b0-446b-b4b6-27225c87e822 on hv-cinder-83979 May 31 18:33:29.446622 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-191473e6-508b-486c-8e79-a0a984df9318 req-2376155d-3b53-44a2-bfbb-3b4a88343298 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028106 May 31 18:33:29.447211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 360/732] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:29.474915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:29.478380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:29.484749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:29.486190 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:29.487375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b413d135-2aab-4ca4-a58d-0c8acd465427 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1598 microversion: 2.20 time: 0.298366 May 31 18:33:29.487919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 373/733] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:33:29 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1598 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:33:29.508920 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:29.509601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:29.515887 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.516405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.517190 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:29.517632 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:29.621775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ea824451-d77a-409b-b6aa-65c14db2c666 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.119775 May 31 18:33:29.622410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 361/734] 10.222.0.17 () {60 vars in 1315 bytes} [Tue May 31 18:33:29 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:33:30.433605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:30.434222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:30.441423 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:30.441871 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:30.442637 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:30.443078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:30.579445 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:30.587380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bcdf2451-e327-40cd-9bd2-7f45481bc154 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.157482 May 31 18:33:30.587955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 374/735] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:30 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:30.751185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-c60c8055-5126-45d5-9ae2-c051e7111a54 req-d868d6d8-0450-464c-9ca3-c1c5caaee5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:30.760213 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-c60c8055-5126-45d5-9ae2-c051e7111a54 req-d868d6d8-0450-464c-9ca3-c1c5caaee5d5 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:30.760664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-c60c8055-5126-45d5-9ae2-c051e7111a54 req-d868d6d8-0450-464c-9ca3-c1c5caaee5d5 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:30.774008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-c60c8055-5126-45d5-9ae2-c051e7111a54 req-d868d6d8-0450-464c-9ca3-c1c5caaee5d5 service nova] Creating event network-changed:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:33:30.778862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-c60c8055-5126-45d5-9ae2-c051e7111a54 req-d868d6d8-0450-464c-9ca3-c1c5caaee5d5 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031892 May 31 18:33:30.779448 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 362/736] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:31.604239 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:31.604880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:31.611722 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:31.612058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:31.612858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:31.613307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:31.746305 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:31.753916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-929d9428-97b2-4a11-8863-aa65a886e0b6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.153610 May 31 18:33:31.754480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 375/737] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:31 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:32.773227 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:32.773922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:32.779983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:32.780472 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:32.781232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:32.781667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:32.916987 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:32.924610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8edb752f-0572-4afa-ba95-c7c65e34b298 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.156392 May 31 18:33:32.925160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 363/738] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:32 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:33.941988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:33.942588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:33.949647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:33.950087 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:33.950842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:33.951270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:34.079462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:34.087218 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6032d42c-8690-48fc-a676-c486d2f78041 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.149075 May 31 18:33:34.087781 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 376/739] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:33 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:35.105480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:35.106075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:35.112546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:35.112991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:35.113753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:35.114189 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:35.248556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:35.256359 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-688e5586-9daa-42c8-a59c-e91721db0316 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.155272 May 31 18:33:35.256918 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 364/740] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:35 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:36.262433 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-004422f3-44df-4892-8545-03b319073356 req-480776fa-9808-4503-af3f-c0448ca805fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10c2fd8-42b0-446b-b4b6-27225c87e822", "name": "network-vif-plugged", "status": "completed", "tag": "2dd8b304-ffcc-4998-aac2-e47690d5ad71"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:36.267846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:36.272624 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:36.274103 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:36.275726 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-004422f3-44df-4892-8545-03b319073356 req-480776fa-9808-4503-af3f-c0448ca805fa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:36.276379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:36.276526 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-004422f3-44df-4892-8545-03b319073356 req-480776fa-9808-4503-af3f-c0448ca805fa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:36.277091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=10 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:36.283536 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:36.283992 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:36.284797 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:36.285237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:36.290557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-004422f3-44df-4892-8545-03b319073356 req-480776fa-9808-4503-af3f-c0448ca805fa service nova] Creating event network-vif-plugged:2dd8b304-ffcc-4998-aac2-e47690d5ad71 for instance f10c2fd8-42b0-446b-b4b6-27225c87e822 on hv-cinder-83979 May 31 18:33:36.295808 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-004422f3-44df-4892-8545-03b319073356 req-480776fa-9808-4503-af3f-c0448ca805fa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036976 May 31 18:33:36.296843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 377/741] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:36.428965 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:36.437111 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-06b48ec2-87b3-4945-948c-48ab824121dc tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.168874 May 31 18:33:36.437681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 365/742] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:36 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:37.454534 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:37.455222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:37.462857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:37.463298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:37.464110 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:37.464545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:37.592474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:37.599715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a923178b-00d7-4b13-bf45-febc56024b45 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1364 microversion: 2.1 time: 0.149338 May 31 18:33:37.600411 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 378/743] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:37 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:38.615960 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:38.616948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:38.624739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:38.625191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:38.625962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:38.626400 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:38.754922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:38.762885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-edd098ca-d04a-42e6-a3ff-74cf59d0ab61 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1551 microversion: 2.1 time: 0.150804 May 31 18:33:38.763441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 366/744] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:38 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1551 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:38.779592 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:38.780072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:38.786370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:38.786811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:38.787561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:38.788185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:38.867687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bad401c9-5798-49e3-97dc-7199aa7b2da8 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091620 May 31 18:33:38.868228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 379/745] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:33:38 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:39.781969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-804293d7-e750-44ce-8e95-43676a4a1419 req-12bce867-983e-4774-9e30-2529bb27b803 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f10c2fd8-42b0-446b-b4b6-27225c87e822", "tag": "2dd8b304-ffcc-4998-aac2-e47690d5ad71"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:39.785925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:39.792613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-804293d7-e750-44ce-8e95-43676a4a1419 req-12bce867-983e-4774-9e30-2529bb27b803 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:39.793047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-804293d7-e750-44ce-8e95-43676a4a1419 req-12bce867-983e-4774-9e30-2529bb27b803 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:39.797324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=95 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:39.807178 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-804293d7-e750-44ce-8e95-43676a4a1419 req-12bce867-983e-4774-9e30-2529bb27b803 service nova] Creating event network-changed:2dd8b304-ffcc-4998-aac2-e47690d5ad71 for instance f10c2fd8-42b0-446b-b4b6-27225c87e822 on hv-cinder-83979 May 31 18:33:39.812332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-804293d7-e750-44ce-8e95-43676a4a1419 req-12bce867-983e-4774-9e30-2529bb27b803 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033977 May 31 18:33:39.813097 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 367/746] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:41.562549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:41.563157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:41.569820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:41.570335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:41.571121 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:41.571557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:41.594072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-adad8c7a-8a39-4195-b3c9-f2aa65d31c1d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/ips" status: 200 len: 148 microversion: 2.1 time: 0.035840 May 31 18:33:41.594557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 380/747] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:33:41 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:42.912514 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e04e982-0b77-478f-90dc-29b1d2942d28"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:42.913926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:42.921772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:42.922234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:42.923020 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:42.923466 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:43.195649 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fca7f79e-8c2d-4115-a2bf-8651c0a32c6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286703 May 31 18:33:43.196284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 368/748] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:33:42 2022] POST /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:50.686084 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e04e982-0b77-478f-90dc-29b1d2942d28"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:50.687140 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:50.689404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:33:50.695261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:50.695834 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:50.696476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:50.696914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:50.777719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Invalid volume: volume 4e04e982-0b77-478f-90dc-29b1d2942d28 is already attached to instances: cf09a33d-5fae-4b44-929f-9423be34f7c5 May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: POST /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments HTTP/1.1 May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 74 May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:33:50.779454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {"volumeAttachment": {"volumeId": "4e04e982-0b77-478f-90dc-29b1d2942d28"}} May 31 18:33:50.780879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Invalid volume: volume 4e04e982-0b77-478f-90dc-29b1d2942d28 is already attached to instances: cf09a33d-5fae-4b44-929f-9423be34f7c5 May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'server_id': 'cf09a33d-5fae-4b44-929f-9423be34f7c5', 'body': {'volumeAttachment': {'volumeId': '4e04e982-0b77-478f-90dc-29b1d2942d28'}}} May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4e04e982-0b77-478f-90dc-29b1d2942d28 is already attached to instances: cf09a33d-5fae-4b44-929f-9423be34f7c5 May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:50.781641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4e04e982-0b77-478f-90dc-29b1d2942d28 is already attached to instances: cf09a33d-5fae-4b44-929f-9423be34f7c5 May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:50.782792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4e04e982-0b77-478f-90dc-29b1d2942d28 is already attached to instances: cf09a33d-5fae-4b44-929f-9423be34f7c5 May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 400 to user: Invalid volume: volume 4e04e982-0b77-478f-90dc-29b1d2942d28 is already attached to instances: cf09a33d-5fae-4b44-929f-9423be34f7c5 {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-24cf6da0-edc1-4ed1-bcaf-4f2a30bfc4e7 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098931 May 31 18:33:50.783964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 381/749] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:33:50 2022] POST /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 18:33:50.841867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:50.842440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:50.848701 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:50.849082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:50.849852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:50.850287 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:50.931691 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lazy-loading 'services' on Instance uuid cf09a33d-5fae-4b44-929f-9423be34f7c5 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:33:51.000593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d2bed1b7-fc5a-49ab-9770-dffc0e21861f tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments/4e04e982-0b77-478f-90dc-29b1d2942d28" status: 202 len: 0 microversion: 2.1 time: 0.163443 May 31 18:33:51.001257 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 369/750] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:33:50 2022] DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments/4e04e982-0b77-478f-90dc-29b1d2942d28 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 18:33:51.006475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:51.007001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:51.010212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:51.011345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:51.013637 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:51.014088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:51.014851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:51.015279 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:51.018501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:51.019013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:51.019880 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:51.020431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:51.039719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lazy-loading 'flavor' on Instance uuid f9d640ec-d458-44c1-954e-3f1b66a0f79c {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:33:51.051915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-19692454-d108-46bf-b2db-1a85974d75a2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046189 May 31 18:33:51.052612 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 370/751] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:33:51 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:33:51.113833 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ab974d3d-de40-43d6-a58f-d4941665a137 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "POST /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c/action" status: 202 len: 0 microversion: 2.1 time: 0.111542 May 31 18:33:51.114574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 382/752] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:33:51 2022] POST /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 18:33:51.122865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:51.123501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:51.129910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:51.130286 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:51.131022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:51.131483 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:51.272220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:51.279758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5bb053f6-5b35-417f-ad75-5a678fc345c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.160933 May 31 18:33:51.280351 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 371/753] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:51 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:52.064796 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:52.065800 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:52.072067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:52.072558 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:52.073354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:52.073788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:52.104642 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a68a3889-a2b5-4028-a9d9-e2d4132de00c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 May 31 18:33:52.105447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 383/754] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:33:52 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:52.297816 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:52.298634 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:52.305102 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:52.305594 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:52.306359 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:52.306798 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:52.442586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:52.452148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4c8985ee-1875-4b76-b132-485bebe12baf tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.157874 May 31 18:33:52.453086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 372/755] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:52 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:53.117806 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:53.118662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:53.125543 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.125988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.126778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.127538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.162349 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1c8c744b-c96d-43a4-8744-61d6ec62c826 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048579 May 31 18:33:53.162908 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 384/756] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:33:53 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:33:53.225067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:53.225566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:53.231702 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.232179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.232937 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.233372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.258245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:33:53.331847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-abfff9ee-035e-48a1-850d-8f5b8d4fc9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 204 len: 0 microversion: 2.1 time: 0.109760 May 31 18:33:53.332604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 373/757] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:33:53 2022] DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:33:53.342012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:53.342622 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:53.348769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.349222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.350308 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.350880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.470314 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:53.471047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:53.477921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.478370 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.479143 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:53.479579 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:53.495045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:53.518672 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4da91f7e-a3ce-4aef-9993-2ff969726d9d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1680 microversion: 2.1 time: 0.164869 May 31 18:33:53.519609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 385/758] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:53 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:53.614827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:53.623013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8d42270e-ee7f-4a18-b4dc-b0ea7a7d75dd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.156944 May 31 18:33:53.623577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 374/759] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:53 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:54.537996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:54.539275 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:54.545728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:54.546173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:54.546940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:54.547398 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:54.641182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:54.641832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:54.648324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:54.648778 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:54.649537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:54.649968 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:54.675456 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:54.683679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2c78c1b4-52e2-41bf-b3b2-e7053e411625 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1680 microversion: 2.1 time: 0.149529 May 31 18:33:54.684281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 386/760] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:54 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:54.786611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:54.794606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9d972a35-49e9-4b3c-b30f-9058b51dae54 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.157313 May 31 18:33:54.795170 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 375/761] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:54 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:55.701112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:55.701731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:55.708063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:55.708552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:55.709351 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:55.709813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:55.810729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:55.811394 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:55.817782 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:55.818234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:55.819006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:55.819459 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:55.986918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:55.994552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d1a29b9d-2662-4cfe-b82c-0f315e9dc034 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1680 microversion: 2.1 time: 0.297343 May 31 18:33:55.995113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 387/762] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:55 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1680 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:56.090678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:56.098541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e3277db4-8465-41bc-96d1-dbea5ecae7bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.291657 May 31 18:33:56.099260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 376/763] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:55 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:56.525001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-62a38604-a6bb-43fc-a698-3b76331709d6 req-f29af03c-5a15-45dd-aa24-61349dd7d91a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf09a33d-5fae-4b44-929f-9423be34f7c5", "name": "network-vif-deleted", "tag": "b0b3e5e9-f455-4a89-8d56-babbf5248d8f"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:56.535699 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-62a38604-a6bb-43fc-a698-3b76331709d6 req-f29af03c-5a15-45dd-aa24-61349dd7d91a service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:56.536179 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-62a38604-a6bb-43fc-a698-3b76331709d6 req-f29af03c-5a15-45dd-aa24-61349dd7d91a service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:56.552079 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-62a38604-a6bb-43fc-a698-3b76331709d6 req-f29af03c-5a15-45dd-aa24-61349dd7d91a service nova] Creating event network-vif-deleted:b0b3e5e9-f455-4a89-8d56-babbf5248d8f for instance cf09a33d-5fae-4b44-929f-9423be34f7c5 on hv-cinder-83979 May 31 18:33:56.559417 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-62a38604-a6bb-43fc-a698-3b76331709d6 req-f29af03c-5a15-45dd-aa24-61349dd7d91a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038096 May 31 18:33:56.560589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 388/764] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:33:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:57.012944 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:57.013362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:57.020137 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:57.020745 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:57.021644 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:57.022205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:57.061659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:57.062109 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:57.062571 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lazy-loading 'fault' on Instance uuid cf09a33d-5fae-4b44-929f-9423be34f7c5 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:33:57.117736 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:57.119191 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:57.125626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:57.126976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:57.128409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:57.130582 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:57.131515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:57.135040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b27800bd-55e8-4edf-8608-792ae6473a8b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 200 len: 1331 microversion: 2.1 time: 0.126349 May 31 18:33:57.136014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 377/765] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:57 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:57.280147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:57.288905 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-911fc370-f970-48e6-ab73-61c71043c808 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.175161 May 31 18:33:57.289613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 389/766] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:57 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:33:58.152545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:58.153160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:58.159453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:58.159899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:58.160683 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:58.161112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:58.174263 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 HTTP/1.1 May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:33:58.175873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:33:58.177363 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'cf09a33d-5fae-4b44-929f-9423be34f7c5'} May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:33:58.178260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:33:58.180278 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:33:58.181549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:33:58.181549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8a8ebeec-ba66-40eb-9911-87c424ec4426 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 404 len: 111 microversion: 2.1 time: 0.028630 May 31 18:33:58.181549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 378/767] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:58 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:33:58.186444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-54f0ef0f-beb1-4fb6-9fe2-6792f726543b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '.version_select at 0x7ffb740df1f0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:58.203864 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-54f0ef0f-beb1-4fb6-9fe2-6792f726543b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577812958" status: 202 len: 0 microversion: 2.1 time: 0.021102 May 31 18:33:58.204446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 390/768] 10.222.0.17 () {58 vars in 1220 bytes} [Tue May 31 18:33:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1577812958 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:33:58.306627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:58.307390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:58.313453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:58.313904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:58.314673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:58.315106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:58.463129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:58.471326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-142dbd12-cf47-4857-9477-d205e704c5bd tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.169243 May 31 18:33:58.471891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 379/769] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:58 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:33:58.810325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c000689e-c2bd-46a7-9335-46e661819c30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: .version_select at 0x7ffb78a80160>, body: {"keypair": {"name": "tempest-keypair-1504916591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJZZ9xgTdqe0rwwCNuvEq/ihct+nbtClgie11nOfsLG2wnRy0fSXzWEPEz2ePAUpjMLa5c8JiosEbsmKDE5I16yCD7TUfG1S5uXcUK+TfieC2x31C0m0yrbOweIANk8aeQ=="}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:33:58.824984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-c000689e-c2bd-46a7-9335-46e661819c30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:33:58.828748 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-c000689e-c2bd-46a7-9335-46e661819c30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'key_pairs'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:33:58.854922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c000689e-c2bd-46a7-9335-46e661819c30 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048445 May 31 18:33:58.855507 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 391/770] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:33:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:33:59.489543 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:33:59.490539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:33:59.497906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:59.498499 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:59.499654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:33:59.500040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:33:59.732238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:33:59.740202 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-dbe72891-0f15-4563-95dc-68bf5ae2716a tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.254481 May 31 18:33:59.740793 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 380/771] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:33:59 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:00.173385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-140254372", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "900f31eb-512c-4a14-a74f-282a3e50261b"}], "security_groups": [{"name": "tempest-securitygroup--1689144590"}], "key_name": "tempest-keypair-1504916591", "user_data": "}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:00.271512 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] validate_networks() for [('900f31eb-512c-4a14-a74f-282a3e50261b', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:34:00.643762 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:34:00.644222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:34:00.644706 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:34:00.645113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:34:00.645522 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:34:00.654916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:00.655367 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:00.656604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:00.657049 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:00.664440 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:00.678163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:34:00.682658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Getting quotas for user c2b7c2402a774a88ba6c15a2adcd5bd1 and project cc148ca451e24f97aecc883782f1ef9f. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:34:00.693541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:34:00.696341 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:34:00.742013 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5b626464-8442-455c-ad39-87ff22ccf6b5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573316 May 31 18:34:00.742650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 392/772] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:34:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:34:00.752849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0c203d86-71ee-4286-9ea4-e73953b17079 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:00.753929 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0c203d86-71ee-4286-9ea4-e73953b17079 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:00.758624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:00.759242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:00.765888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:00.766369 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:00.767116 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:00.767554 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:00.815106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0c203d86-71ee-4286-9ea4-e73953b17079 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:00.824040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0c203d86-71ee-4286-9ea4-e73953b17079 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1241 microversion: 2.1 time: 0.075031 May 31 18:34:00.825069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 381/773] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:00 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:00.918027 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:00.925937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1546325d-8e3f-42fe-a423-0a1320c88be8 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.173042 May 31 18:34:00.926493 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 393/774] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:00 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:34:01.841207 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:01.841998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:01.850677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:01.852056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:01.853038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:01.853479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:01.858116 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:01.942870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:01.943487 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:01.943621 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:01.951101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:01.951775 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:01.951919 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cb5aba53-3715-45fd-b3a8-7b24f64d8ec0 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1311 microversion: 2.1 time: 0.114625 May 31 18:34:01.952682 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 382/775] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:01 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:01.953038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:01.953662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:02.231158 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:02.238777 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f5a1e405-fbb3-4d4d-88dc-4765a20c8986 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.299792 May 31 18:34:02.239357 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 394/776] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:01 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:02.969089 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:02.969832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:02.977577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:02.978031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:02.978915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:02.979573 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:03.088870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:03.096347 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4da2ccd8-e06d-4699-9755-8c13c2e3d5fa tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1299 microversion: 2.1 time: 0.131133 May 31 18:34:03.096904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 383/777] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:02 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1299 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:03.258749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:03.259489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:03.270471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:03.271009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:03.273032 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:03.273554 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:03.419817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:03.427377 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-eaf5437b-2f39-4e15-a84e-e2aef8a61fdc tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.174326 May 31 18:34:03.427936 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 395/778] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:03 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:04.114405 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:04.115010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:04.121551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:04.121997 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:04.122749 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:04.123179 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:04.251915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:04.260317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7c69e2f2-b6de-49fe-8c7f-f18db60a99e3 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.149729 May 31 18:34:04.260879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 384/779] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:04 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:04.444959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:04.445897 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:04.452309 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:04.452755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:04.453539 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:04.453966 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:04.672646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:04.682635 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-90b1dba4-9aa6-4ff6-8b30-c1a96e9639d5 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.241776 May 31 18:34:04.692380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 396/780] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:04 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:05.048139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-545d3e02-dc8b-4378-9f6f-5e82abb4edbf req-21feadc9-218b-400d-ba61-47c09da7944e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11", "tag": "3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:05.062646 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-545d3e02-dc8b-4378-9f6f-5e82abb4edbf req-21feadc9-218b-400d-ba61-47c09da7944e service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.063291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-545d3e02-dc8b-4378-9f6f-5e82abb4edbf req-21feadc9-218b-400d-ba61-47c09da7944e service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.078552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-545d3e02-dc8b-4378-9f6f-5e82abb4edbf req-21feadc9-218b-400d-ba61-47c09da7944e service nova] Creating event network-changed:3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1 for instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 on hv-cinder-83979 May 31 18:34:05.083775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-545d3e02-dc8b-4378-9f6f-5e82abb4edbf req-21feadc9-218b-400d-ba61-47c09da7944e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046590 May 31 18:34:05.084813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 385/781] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:34:05.277541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:05.278242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:05.284212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.284662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.285434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.285873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.415438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:05.422705 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c035b1fd-4df2-432f-8b8d-efbf9a09d8be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.149091 May 31 18:34:05.423256 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 397/782] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:05 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:05.701582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:05.702279 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:05.708389 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.708841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.709602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.710041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.844127 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:05.852000 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-040e40d4-d82e-42cf-b92b-70490e1fefd6 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1511 microversion: 2.1 time: 0.155104 May 31 18:34:05.852592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 386/783] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:05 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:05.868863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:05.869435 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:05.875783 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.876270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.877031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.877465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.963973 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7e5e3dfe-3801-49ad-844a-29273277e202 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "POST /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c/action" status: 202 len: 0 microversion: 2.1 time: 0.099510 May 31 18:34:05.964604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 398/784] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:34:05 2022] POST /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:34:05.972485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:05.973101 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:05.979374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.979827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:05.980655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:05.981091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:06.122245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:06.130113 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-15e211c4-6d77-463b-ae21-13e969f8e589 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1519 microversion: 2.1 time: 0.161411 May 31 18:34:06.131218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 387/785] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:05 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:06.439514 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:06.440224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:06.446944 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:06.447392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:06.448189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:06.448625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:06.588175 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:06.597867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a05ab8bd-b8dc-4f27-b349-978b24bd888d tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.162075 May 31 18:34:06.598445 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 399/786] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:06 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:07.147097 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:07.147643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:07.154409 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:07.154863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:07.155638 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:07.156078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:07.293021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:07.300623 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9e0fe73f-2305-462e-9795-32554db09e99 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1519 microversion: 2.1 time: 0.157495 May 31 18:34:07.301191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 388/787] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:07 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:07.614467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:07.615074 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:07.621683 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:07.622125 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:07.622879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:07.623316 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:07.757201 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:07.768214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d8c2b7ea-393d-4c4c-ac84-36cc3aad6c07 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.157347 May 31 18:34:07.769036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 400/788] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:07 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:08.319308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:08.320862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:08.328013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:08.328738 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:08.329666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:08.330232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:08.351699 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-3a5300a9-4994-4cb4-bbbd-dda5a1b7eb2e req-2744d2f2-d4e4-407c-9a75-7f19c9dc6020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "name": "network-vif-unplugged", "status": "completed", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:08.361018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-3a5300a9-4994-4cb4-bbbd-dda5a1b7eb2e req-2744d2f2-d4e4-407c-9a75-7f19c9dc6020 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:08.361594 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-3a5300a9-4994-4cb4-bbbd-dda5a1b7eb2e req-2744d2f2-d4e4-407c-9a75-7f19c9dc6020 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:08.378896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.compute.server_external_events [req-3a5300a9-4994-4cb4-bbbd-dda5a1b7eb2e req-2744d2f2-d4e4-407c-9a75-7f19c9dc6020 service nova] Unable to find a host for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c. Dropping event network-vif-unplugged {{(pid=117589) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 18:34:08.380321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-3a5300a9-4994-4cb4-bbbd-dda5a1b7eb2e req-2744d2f2-d4e4-407c-9a75-7f19c9dc6020 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033737 May 31 18:34:08.381174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 401/789] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:34:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 31 18:34:08.543905 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:08.552354 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4cdede08-dbfc-48e5-8bee-abb753f85ee9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1521 microversion: 2.1 time: 0.237256 May 31 18:34:08.552864 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 389/790] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:08 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:08.790319 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:08.790933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:08.797484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:08.797931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:08.798694 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:08.799125 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:08.942205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:08.950870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a1a369fe-93bc-49af-80a2-bb65f6c0f896 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.165148 May 31 18:34:08.951427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 402/791] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:08 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:09.570807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:09.571427 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:09.577993 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:09.578445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:09.579240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:09.579773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:09.790122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:09.797679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1755ab2e-45d3-461b-96a6-c76455877231 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.231367 May 31 18:34:09.798257 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 390/792] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:09 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:09.967429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:09.968104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:09.974734 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:09.975187 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:09.976001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:09.976534 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:10.102102 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:10.109375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8168c318-9c10-47a8-ae16-221fd22bf3c1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.145765 May 31 18:34:10.109925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 403/793] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:09 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:10.814979 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:10.815706 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:10.819153 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:10.823141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:10.823585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:10.824396 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:10.824833 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:10.963284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:10.971204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-daf72671-fa64-4f40-a9be-d8f9d4e243a2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.160042 May 31 18:34:10.971763 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 391/794] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:10 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:11.126647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:11.127286 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:11.129383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:11.130089 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=10 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:11.137228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:11.137675 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:11.138447 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:11.138880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:11.269493 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:11.277455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3d5cdea9-9993-4b1c-9fb8-b6c7be8d7370 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.154613 May 31 18:34:11.278014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 404/795] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:11 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:11.989981 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:11.991159 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:11.999053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:11.999505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:12.000305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:12.000742 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:12.129593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:12.137393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7aa0e804-110e-4fc4-bc5b-0b788a04c17f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.152628 May 31 18:34:12.137963 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 392/796] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:11 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:12.294898 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:12.295512 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:12.302052 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:12.302499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:12.303263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:12.303702 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:12.419018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-5095f113-16d8-4b61-9535-7a60a86b5551 req-0b66c8f8-c2df-4927-a995-7f3873965729 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11", "name": "network-vif-plugged", "status": "completed", "tag": "3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:12.430950 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-5095f113-16d8-4b61-9535-7a60a86b5551 req-0b66c8f8-c2df-4927-a995-7f3873965729 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:12.431534 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-5095f113-16d8-4b61-9535-7a60a86b5551 req-0b66c8f8-c2df-4927-a995-7f3873965729 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:12.442904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-5095f113-16d8-4b61-9535-7a60a86b5551 req-0b66c8f8-c2df-4927-a995-7f3873965729 service nova] Creating event network-vif-plugged:3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1 for instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 on hv-cinder-83979 May 31 18:34:12.446025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:12.449256 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-5095f113-16d8-4b61-9535-7a60a86b5551 req-0b66c8f8-c2df-4927-a995-7f3873965729 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035872 May 31 18:34:12.450648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 393/797] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:34:12.454495 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-29e27a49-8461-44bf-be84-3f0184c3c6fc tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.163703 May 31 18:34:12.455375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 405/798] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:12 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:13.155252 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:13.155903 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:13.158429 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:13.165231 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:13.165788 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:13.166590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:13.167032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:13.297135 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:13.304717 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-23fa8a7b-4afa-45d5-889e-d14698190d1f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.153758 May 31 18:34:13.305914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 394/799] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:13 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:13.471633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:13.472290 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:13.479631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:13.480168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:13.480950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:13.481389 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:13.615656 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:13.623181 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3c32f039-ecb0-4843-aab5-f08ed14747c9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1367 microversion: 2.1 time: 0.155422 May 31 18:34:13.623739 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 406/800] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:13 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:14.322531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:14.323139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:14.329610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:14.330053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:14.330812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:14.331243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:14.462838 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:14.470284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4f5e6516-201b-4056-82b8-79913894c04b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.151911 May 31 18:34:14.470877 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 395/801] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:14 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:14.640482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:14.640996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:14.647415 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:14.647852 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:14.648643 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:14.649280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:14.781307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:14.788598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-849ae2b6-3341-4924-932b-99811e2f995b tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1557 microversion: 2.1 time: 0.152113 May 31 18:34:14.789147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 407/802] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:14 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:14.805840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:14.806335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:14.812271 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:14.812716 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:14.813479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:14.813920 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:14.889247 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-46d3c16b-4593-4b11-879f-626e437c4659 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087833 May 31 18:34:14.889832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 396/803] 10.222.0.17 () {58 vars in 1274 bytes} [Tue May 31 18:34:14 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:34:15.488075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:15.488716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:15.494787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:15.495358 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:15.496166 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:15.496605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:15.985060 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:15.993060 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7e419a08-cba6-4f53-baf7-36c1580239be tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.508577 May 31 18:34:15.993711 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 408/804] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:15 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:34:16.151806 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-9bd0665b-c985-4d1b-99c1-4f238fe160e0 req-d43432bc-dc90-4486-8202-8effcc2f116c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11", "tag": "3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:16.160381 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9bd0665b-c985-4d1b-99c1-4f238fe160e0 req-d43432bc-dc90-4486-8202-8effcc2f116c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:16.160834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9bd0665b-c985-4d1b-99c1-4f238fe160e0 req-d43432bc-dc90-4486-8202-8effcc2f116c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:16.172954 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-9bd0665b-c985-4d1b-99c1-4f238fe160e0 req-d43432bc-dc90-4486-8202-8effcc2f116c service nova] Creating event network-changed:3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1 for instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 on hv-cinder-83979 May 31 18:34:16.177795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-9bd0665b-c985-4d1b-99c1-4f238fe160e0 req-d43432bc-dc90-4486-8202-8effcc2f116c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030565 May 31 18:34:16.178378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 397/805] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:34:17.010753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:17.011371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:17.018062 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:17.018517 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:17.019921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:17.020394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:17.025586 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:17.160059 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:17.168478 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8b97d086-8bd7-42ae-9c55-4a3d2d3f7e7b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.162041 May 31 18:34:17.169047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 409/806] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:17 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:18.187195 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:18.187877 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:18.194626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:18.195356 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:18.196647 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:18.197316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:18.329012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:18.337959 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cf6f693b-585d-4524-800f-1e2085e01c91 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.155620 May 31 18:34:18.338564 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 398/807] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:18 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:19.355792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:19.356476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:19.362859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:19.363301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:19.364054 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:19.364510 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:19.492283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:19.500479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-176ebb7b-4452-4c6d-ad2a-c889dbb63639 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.149517 May 31 18:34:19.501041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 410/808] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:19 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:20.518093 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:20.518704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:20.526417 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:20.526873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:20.527648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:20.528083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:20.667811 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:20.675291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-495768cb-7c0b-482a-afc4-44d7131981ce tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.161282 May 31 18:34:20.675852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 399/809] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:20 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:21.693230 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:21.693865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:21.696842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:21.703082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:21.703533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:21.704356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:21.704793 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:21.835720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:21.843643 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4ab372f7-8d7f-46ed-898a-c68b95f0dc5c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.154176 May 31 18:34:21.844250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 411/810] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:21 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:22.481185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-2c8b359c-13ab-4a07-a0c4-9918cbf6b7bb req-14971d17-5dd6-4eea-911d-7abb75407de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "name": "network-vif-plugged", "status": "completed", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:22.490235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-2c8b359c-13ab-4a07-a0c4-9918cbf6b7bb req-14971d17-5dd6-4eea-911d-7abb75407de0 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:22.490704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-2c8b359c-13ab-4a07-a0c4-9918cbf6b7bb req-14971d17-5dd6-4eea-911d-7abb75407de0 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:22.503932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-2c8b359c-13ab-4a07-a0c4-9918cbf6b7bb req-14971d17-5dd6-4eea-911d-7abb75407de0 service nova] Creating event network-vif-plugged:1d0bca79-ab73-4643-a78f-e91fb3ea863b for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c on hv-cinder-83979 May 31 18:34:22.509958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-2c8b359c-13ab-4a07-a0c4-9918cbf6b7bb req-14971d17-5dd6-4eea-911d-7abb75407de0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 May 31 18:34:22.510663 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 400/811] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:34:22.863178 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:22.863812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:22.870923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:22.871639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:22.873004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:22.873703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:23.017193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:23.025261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bbcc9214-c50b-4240-8817-4bdfc7157bc3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.165377 May 31 18:34:23.025838 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 412/812] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:22 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:34:24.043240 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:24.043938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:24.050609 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:24.051058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:24.051819 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:24.052289 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:24.182288 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:24.184607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=100 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:24.191075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c6464ce4-10b9-4b75-b904-ff412f28501e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1577 microversion: 2.1 time: 0.152681 May 31 18:34:24.191632 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 401/813] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:24 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:25.208244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:25.208815 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:25.215337 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:25.215786 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:25.216602 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:25.217038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:25.351918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:25.361864 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2341b760-631a-416c-bc47-1b90f188be5f tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1564 microversion: 2.1 time: 0.157586 May 31 18:34:25.362428 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 413/814] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:34:25 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1564 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:34:45.785187 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:45.785771 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:45.787966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=15 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:45.794008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:45.794452 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:45.795204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:45.795643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:45.818058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3a530fc6-f622-4bb5-adf6-bbc49ae9312f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/ips" status: 200 len: 151 microversion: 2.20 time: 0.036765 May 31 18:34:45.818605 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 402/815] 10.222.0.17 () {60 vars in 1288 bytes} [Tue May 31 18:34:45 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:34:47.838394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:47.838965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:47.841834 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=5 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:47.842473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=29 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:34:47.848318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:47.848761 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:47.849513 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:47.849945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:47.877466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lazy-loading 'flavor' on Instance uuid d4134a34-2a85-4a0b-96fd-f221227ee2c4 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:34:48.300298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e038bec0-51b8-414f-bd2a-c089bcfcdbd5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/action" status: 202 len: 0 microversion: 2.20 time: 0.465736 May 31 18:34:48.300909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 414/816] 10.222.0.17 () {62 vars in 1318 bytes} [Tue May 31 18:34:47 2022] POST /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/action => generated 0 bytes in 467 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 18:34:48.309591 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:48.310616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:48.317317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:48.317757 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:48.318526 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:48.318951 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:48.449764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:48.457595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:48.459104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:48.460299 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-98747d03-b102-4bc3-b1aa-36803cdd2c4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.155213 May 31 18:34:48.460850 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 403/817] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:48 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:49.479704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:49.480825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:49.487466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:49.487909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:49.488707 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:49.489141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:49.675017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:49.684916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:49.686425 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:49.687584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e7f51167-876f-4b6f-8239-a409922a7f47 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.212539 May 31 18:34:49.688152 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 415/818] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:49 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:50.706874 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:50.707412 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:50.713845 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:50.715602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:50.716395 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:50.716836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:50.894765 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:50.903336 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:50.904872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:50.906035 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-81c7a773-99c8-4928-9dfb-fc8136dcd5c9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.203174 May 31 18:34:50.906585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 404/819] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:50 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:34:51.924501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:51.925036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:51.931615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:51.932110 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:51.932936 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:51.933404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:52.064511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:52.072273 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:52.074600 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:52.075688 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f5827c4b-4a6b-4d0a-bd14-9419570c3c63 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.155107 May 31 18:34:52.076262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 416/820] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:51 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:53.095392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:53.095991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:53.102373 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:53.102817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:53.103573 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:53.104004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:53.232954 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:53.240818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:53.242334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:53.243492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0d72dcc6-f766-4644-b7f8-00c2018d946d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.152016 May 31 18:34:53.244043 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 405/821] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:53 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:54.263088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:54.264238 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:54.270865 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:54.271310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:54.272461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:54.272951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:54.427222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:54.436931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:54.438426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:54.439582 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b5fa8a9c-b51d-4386-8d4b-0fc6599398ed tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.181233 May 31 18:34:54.440146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 417/822] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:54 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:55.057597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:55.058204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:55.064566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:55.065010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:55.065770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:55.066205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:55.088824 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-91878479-563a-4dc1-94b8-b444133f47df tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/ips" status: 200 len: 147 microversion: 2.1 time: 0.035070 May 31 18:34:55.090096 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 406/823] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:34:55 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/ips => generated 147 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:34:55.462766 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:55.463375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:55.469896 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:55.470344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:55.471108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:55.471547 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:55.603723 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:55.612358 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:55.613855 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:55.615018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-37c80d99-6391-4c3d-b6b7-18a2a6988f40 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.156171 May 31 18:34:55.615613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 418/824] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:55 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:56.404942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edc669ef-ce08-43e7-b184-cf758ba0bfc7"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:34:56.406014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:56.412618 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:56.413071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:56.413840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:56.414284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:56.633679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:56.634499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:56.641901 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:56.642566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:56.643334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:56.643769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:56.681362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ebf83db8-1f57-409d-86c4-68c4dd4d85c6 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280968 May 31 18:34:56.686617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 407/825] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:34:56 2022] POST /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:34:56.788624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:56.796718 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:56.798211 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:56.799356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-945b64dc-8e7c-4f80-8a4c-613edc343d99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.169923 May 31 18:34:56.799886 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 419/826] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:56 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:34:57.818785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:57.819519 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:57.826169 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:57.826623 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:57.827394 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:57.827834 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:57.961602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:57.970116 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:57.971660 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:57.972839 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4bc6ea67-ef69-49cd-bacd-7cd18112ed49 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.159041 May 31 18:34:57.973380 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 408/827] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:57 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:34:58.991868 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:34:58.992515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:34:58.999076 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:58.999524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:59.000321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:34:59.000758 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:34:59.133424 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:59.141818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:59.143325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:34:59.144543 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9df1a25e-7ddd-42d0-9137-8948f06f4ff0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.156488 May 31 18:34:59.145080 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 420/828] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:34:58 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:00.162923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:00.163451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:00.170620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:00.171068 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:00.171825 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:00.172297 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:00.300012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:00.307888 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:00.309694 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:00.310842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ceb076a3-c16c-4d80-b537-3d40b8d66adc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1744 microversion: 2.20 time: 0.151923 May 31 18:35:00.311385 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 409/829] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:00 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:35:01.330799 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:01.331358 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:01.337984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:01.338457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:01.340606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:01.341062 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:01.557968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:01.565948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:01.567552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:01.568747 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-466a89c7-eb63-46de-afef-d8766eb98f85 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1744 microversion: 2.20 time: 0.242605 May 31 18:35:01.569298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 421/830] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:01 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1744 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:02.587173 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:02.587849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:02.595041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:02.595522 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:02.596383 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:02.596911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:02.734047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:02.742776 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:02.746728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:02.746728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-93074ecf-b242-426d-9ce4-10711169ef9f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1744 microversion: 2.20 time: 0.162603 May 31 18:35:02.746728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 410/831] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:02 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:03.765435 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:03.766079 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:03.773327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:03.773774 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:03.774561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:03.774999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:03.919230 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:03.927280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:03.928961 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:03.930125 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8489248f-cc44-4b91-9796-5be48e16634c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1744 microversion: 2.20 time: 0.169273 May 31 18:35:03.930678 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 422/832] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:03 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:04.305462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:04.306454 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:04.313284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.313753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:04.314559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.315037 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:04.345909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d5db29c0-ec5b-4a95-815f-6bbd57b9d2d7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 May 31 18:35:04.346495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 411/833] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:35:04 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:04.356360 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:04.356856 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:04.362808 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.363255 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:04.364016 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.364484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:04.392471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5df3677f-f2f2-46e5-b6c7-bba46ddc6362 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/edc669ef-ce08-43e7-b184-cf758ba0bfc7" status: 200 len: 194 microversion: 2.1 time: 0.040135 May 31 18:35:04.393033 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 423/834] 10.222.0.17 () {58 vars in 1412 bytes} [Tue May 31 18:35:04 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/edc669ef-ce08-43e7-b184-cf758ba0bfc7 => generated 194 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:04.708110 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-1c7ebd1e-4224-42e9-8382-3fc5d5151415 req-724f86c3-8694-45ed-ad59-8e7b77560faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "name": "network-vif-plugged", "status": "completed", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:04.718119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-1c7ebd1e-4224-42e9-8382-3fc5d5151415 req-724f86c3-8694-45ed-ad59-8e7b77560faa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.718603 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-1c7ebd1e-4224-42e9-8382-3fc5d5151415 req-724f86c3-8694-45ed-ad59-8e7b77560faa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:04.731554 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-1c7ebd1e-4224-42e9-8382-3fc5d5151415 req-724f86c3-8694-45ed-ad59-8e7b77560faa service nova] Creating event network-vif-plugged:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:35:04.736682 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-1c7ebd1e-4224-42e9-8382-3fc5d5151415 req-724f86c3-8694-45ed-ad59-8e7b77560faa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032486 May 31 18:35:04.737723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 412/835] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:04.948321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:04.948985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:04.955402 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.955849 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:04.956642 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:04.957080 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:05.084848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:05.092932 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:05.094537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:05.095802 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0ee46ca1-dbe0-423c-8c2e-eaa0d502b3c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1744 microversion: 2.20 time: 0.151378 May 31 18:35:05.096416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 424/836] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:04 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:05.721641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b448978e-2d0e-49b5-b7c7-631cc4e44f2d"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:05.722767 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:05.729384 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:05.730364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:05.731125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:05.731559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:05.988006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ca21f06a-f861-4d93-bd84-6520c96eab73 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "POST /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270982 May 31 18:35:05.988877 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 413/837] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:35:05 2022] POST /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:35:06.114958 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:06.115611 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:06.122737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:06.123384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:06.124348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:06.124949 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:06.260318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:06.268467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:06.269950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:06.271100 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-877fc93e-d479-4143-a707-0789b5cba2e7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1744 microversion: 2.20 time: 0.160296 May 31 18:35:06.271642 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 425/838] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:06 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:07.289406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:07.290106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:07.297674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:07.298129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:07.298928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:07.299370 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:07.445859 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:07.454239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:07.456010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:07.457270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c3c2a4cc-c2e5-41c2-93c3-dffb3d7abd7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.172085 May 31 18:35:07.457906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 414/839] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:07 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:08.476903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:08.477574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:08.485326 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:08.486014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:08.487000 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:08.487605 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:08.628876 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:08.638284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:08.640036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:08.641219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7a4c06ba-9df4-4c9f-8061-7a2a05c96f55 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.168179 May 31 18:35:08.651871 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 426/840] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:08 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:09.659105 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:09.660475 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:09.669654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:09.670242 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:09.671219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:09.671753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:09.882977 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:09.899142 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:09.900707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:09.903239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-05092e61-836f-4ca8-b6c0-506e2e91d090 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.248287 May 31 18:35:09.914222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 415/841] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:09 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:10.922330 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:10.922933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:10.930008 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:10.930446 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:10.931405 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:10.931837 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:11.088122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:11.105371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:11.106893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:11.108064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-65febdae-f426-4a48-9bcc-02c2605d15e3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.189630 May 31 18:35:11.108956 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 427/842] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:10 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:12.129283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:12.130642 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:12.139038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:12.139411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:12.140127 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:12.140531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:12.289543 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:12.297579 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:12.299112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:12.300306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b32b2470-154a-43ef-ab62-572b40b0255a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.175885 May 31 18:35:12.300857 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 416/843] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:12 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:13.320444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:13.321072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:13.329151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.329948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.330925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.331377 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.351956 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:13.504444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:13.521866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:13.523472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:13.524636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0118a4b1-af94-4d25-804e-53f1c35a4569 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.208472 May 31 18:35:13.535722 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 428/844] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:13 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:13.591360 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:13.593077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:13.599971 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.600671 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.601561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.602064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.605701 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:13.640361 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d12b5d49-31ed-44f4-bec6-e53ef166641f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053511 May 31 18:35:13.645510 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 417/845] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:35:13 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:13.800364 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:13.800964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:13.807356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.808167 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.809073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.809520 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.842827 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ec258d4e-a59a-49fb-9bbd-75c7a01b5aa7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/edc669ef-ce08-43e7-b184-cf758ba0bfc7" status: 200 len: 194 microversion: 2.1 time: 0.046542 May 31 18:35:13.847957 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 429/846] 10.222.0.17 () {58 vars in 1412 bytes} [Tue May 31 18:35:13 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/edc669ef-ce08-43e7-b184-cf758ba0bfc7 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:13.853515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:13.854030 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:13.860366 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.860821 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.861586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:13.862241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:13.967668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lazy-loading 'services' on Instance uuid f10c2fd8-42b0-446b-b4b6-27225c87e822 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:35:14.050300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9b2a76ff-c891-4e2e-8754-7639385cf837 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/edc669ef-ce08-43e7-b184-cf758ba0bfc7" status: 202 len: 0 microversion: 2.1 time: 0.200529 May 31 18:35:14.055564 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 418/847] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:35:13 2022] DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/edc669ef-ce08-43e7-b184-cf758ba0bfc7 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:35:14.542867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:14.543482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:14.550480 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:14.551162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:14.551934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:14.552662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:14.712036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:14.720591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:14.722380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:14.723663 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-113038bd-381e-4f92-bc4b-2ce34ed7c485 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.184761 May 31 18:35:14.724244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 430/848] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:14 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:15.743092 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:15.744235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:15.751311 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:15.751848 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:15.752785 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:15.753234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:15.905590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:15.914589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:15.916123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:15.917369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e6ac85f6-7e89-48e7-bc1c-2cfd5035f4b0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.179144 May 31 18:35:15.918611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 419/849] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:15 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:35:16.251938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:16.252549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:16.258910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:16.259574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:16.260393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:16.261075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:16.290878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-152ac6a6-4052-41ec-9621-f4fd9632d180 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/b448978e-2d0e-49b5-b7c7-631cc4e44f2d" status: 200 len: 194 microversion: 2.1 time: 0.042715 May 31 18:35:16.292538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 431/850] 10.222.0.17 () {58 vars in 1412 bytes} [Tue May 31 18:35:16 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/b448978e-2d0e-49b5-b7c7-631cc4e44f2d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:16.302906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:16.303705 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:16.306001 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=37 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:16.311697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:16.312168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:16.312943 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:16.313380 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:16.419689 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lazy-loading 'services' on Instance uuid f10c2fd8-42b0-446b-b4b6-27225c87e822 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:35:16.501091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-330708bc-e255-45b9-85e1-0f807554f8f7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/b448978e-2d0e-49b5-b7c7-631cc4e44f2d" status: 202 len: 0 microversion: 2.1 time: 0.202167 May 31 18:35:16.502051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 420/851] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:35:16 2022] DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments/b448978e-2d0e-49b5-b7c7-631cc4e44f2d => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:35:16.936947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:16.937566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:16.943701 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:16.944267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:16.945106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:16.945548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:17.078186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:17.086884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:17.088437 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:17.089666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-15726a47-2e03-4459-a64b-b8ffaac2bb90 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1739 microversion: 2.20 time: 0.157613 May 31 18:35:17.090219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 432/852] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:16 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:18.108394 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:18.109358 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:18.115574 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.116021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.116804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.117236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.319035 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:18.327736 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:18.329281 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:18.330446 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5c157f4f-1d30-49b7-bd42-31c0aa8e2685 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1721 microversion: 2.20 time: 0.227032 May 31 18:35:18.331248 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 421/853] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:18 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:18.741411 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:18.742454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:18.744888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=39 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:18.750297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.750741 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.751500 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.751930 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.780513 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8d415302-f4ff-4d6c-87a3-daa06804c03f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042938 May 31 18:35:18.781050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 433/854] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:35:18 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:35:18.885046 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:18.886069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:18.892941 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.893387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.894138 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.894567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.922812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ef2ff488-4600-4dbd-9e4d-cd74ea1fef12 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041536 May 31 18:35:18.923304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 422/855] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:35:18 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:35:18.990976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:18.991467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:18.998222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.998668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:18.999425 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:18.999862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:19.024429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:35:19.100920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-95847bcb-921d-48b5-8bbc-8da500a4de74 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 204 len: 0 microversion: 2.1 time: 0.113447 May 31 18:35:19.101490 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 434/856] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:35:18 2022] DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:35:19.110106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:19.110725 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:19.116960 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:19.117416 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:19.118171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:19.118608 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:19.247711 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:19.255413 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-91950206-7ecc-4bad-bfdd-9e7273b6d3e7 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1676 microversion: 2.1 time: 0.149714 May 31 18:35:19.255970 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 423/857] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:19 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:19.349550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:19.350248 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:19.356951 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:19.357403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:19.358168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:19.358608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:19.490627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:19.498796 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:19.500313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:19.501461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3bc1f925-fe20-4a91-b76a-fb8f7f9eb696 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1721 microversion: 2.20 time: 0.156163 May 31 18:35:19.502008 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 435/858] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:19 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:20.272763 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:20.273382 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:20.280236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:20.280953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:20.281794 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:20.282229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:20.418604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:20.426038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cc60a5c1-8112-4eae-8199-6d0979bfcbae tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1676 microversion: 2.1 time: 0.157176 May 31 18:35:20.426609 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 424/859] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:20 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:20.519563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:20.520196 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:20.526585 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:20.527033 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:20.527963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:20.528589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:20.656472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:20.664399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:20.665926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:20.667078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bd6b0a27-0a2e-4b2e-bb73-4d3802a30040 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1721 microversion: 2.20 time: 0.151658 May 31 18:35:20.667618 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 436/860] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:20 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:20.732486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-fac59d7f-4aa2-4b6a-a6bc-fd4286df6300 req-b3156a35-2c6d-497e-a5be-5c82f705c8f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "name": "network-vif-unplugged", "status": "completed", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:20.740952 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fac59d7f-4aa2-4b6a-a6bc-fd4286df6300 req-b3156a35-2c6d-497e-a5be-5c82f705c8f6 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:20.741439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fac59d7f-4aa2-4b6a-a6bc-fd4286df6300 req-b3156a35-2c6d-497e-a5be-5c82f705c8f6 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:20.755273 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-fac59d7f-4aa2-4b6a-a6bc-fd4286df6300 req-b3156a35-2c6d-497e-a5be-5c82f705c8f6 service nova] Creating event network-vif-unplugged:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:35:20.763150 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-fac59d7f-4aa2-4b6a-a6bc-fd4286df6300 req-b3156a35-2c6d-497e-a5be-5c82f705c8f6 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034719 May 31 18:35:20.763826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 425/861] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:35:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:21.444015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:21.444654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:21.451338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:21.451778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:21.452562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:21.452993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:21.582826 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:21.591141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ec26bfe3-6edb-4687-bdf7-52ed8886d41e tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1676 microversion: 2.1 time: 0.150537 May 31 18:35:21.591859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 437/862] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:21 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:21.687365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:21.688063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:21.694600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:21.695051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:21.695836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:21.696304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:21.828186 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:21.836980 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:21.838707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:21.840040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3b3e6eb3-14ba-4582-9c4e-1b0f0a2cd4c4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1724 microversion: 2.20 time: 0.157859 May 31 18:35:21.840686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 426/863] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:21 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:21.858031 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e07c077c-8096-4132-966f-70cd3ab67046"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:21.859036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:21.865021 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:21.865472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:21.866234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:21.866668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.136178 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-47730898-ba52-4e82-8d9b-080f1db7fbc7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.282279 May 31 18:35:22.136784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 438/864] 10.222.0.17 () {62 vars in 1363 bytes} [Tue May 31 18:35:21 2022] POST /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments => generated 188 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:35:22.250235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:22.250801 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:22.256979 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:22.257419 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.258171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:22.258597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.366795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e9b04b77-94ca-4508-9817-b5d6b369b675 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/action" status: 202 len: 0 microversion: 2.20 time: 0.121375 May 31 18:35:22.367338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 427/865] 10.222.0.17 () {62 vars in 1318 bytes} [Tue May 31 18:35:22 2022] POST /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 31 18:35:22.377613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:22.378374 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:22.388321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:22.388777 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.389553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:22.389988 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.608925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:22.609549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:22.616290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:22.616667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.618324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:22.618324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:22.625603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:22.636424 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:22.638966 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:22.640548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-10a48b56-3dde-47dc-9434-e99836349cd1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1750 microversion: 2.20 time: 0.268869 May 31 18:35:22.641244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 439/866] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:22 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1750 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:22.894680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:22.902614 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-21eb682f-b1b1-412c-ae8e-ada28314086d tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1676 microversion: 2.1 time: 0.297612 May 31 18:35:22.903387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 428/867] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:22 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1676 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:35:23.428528 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-1bfc5ef7-e859-4cd4-b430-f06bcd838a86 req-6f31cc82-8bcf-4af5-b441-327f1276e81b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f10c2fd8-42b0-446b-b4b6-27225c87e822", "name": "network-vif-deleted", "tag": "2dd8b304-ffcc-4998-aac2-e47690d5ad71"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:23.440748 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1bfc5ef7-e859-4cd4-b430-f06bcd838a86 req-6f31cc82-8bcf-4af5-b441-327f1276e81b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:23.441184 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1bfc5ef7-e859-4cd4-b430-f06bcd838a86 req-6f31cc82-8bcf-4af5-b441-327f1276e81b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:23.454101 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-1bfc5ef7-e859-4cd4-b430-f06bcd838a86 req-6f31cc82-8bcf-4af5-b441-327f1276e81b service nova] Creating event network-vif-deleted:2dd8b304-ffcc-4998-aac2-e47690d5ad71 for instance f10c2fd8-42b0-446b-b4b6-27225c87e822 on hv-cinder-83979 May 31 18:35:23.461282 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-1bfc5ef7-e859-4cd4-b430-f06bcd838a86 req-6f31cc82-8bcf-4af5-b441-327f1276e81b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037489 May 31 18:35:23.462138 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 440/868] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:23.659527 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:23.660425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:23.667402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:23.667824 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:23.668932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:23.669487 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:23.804343 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:23.813072 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:23.814584 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:23.815757 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5a2febe9-2082-4ca1-bd2e-cf902c402a1b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1752 microversion: 2.20 time: 0.160162 May 31 18:35:23.816358 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 429/869] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:23 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:23.922297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:23.923282 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:23.930399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:23.930854 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:23.931607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:23.932037 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:23.957759 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:23.978627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:23.978627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:23.979072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lazy-loading 'fault' on Instance uuid f10c2fd8-42b0-446b-b4b6-27225c87e822 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:35:24.026409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c6d1ac15d024f77bb363170ab423c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ea083067dfc4b6194457652a3501317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:24.033880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-38632801-db25-41e4-8d7e-04fd53904a01 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 200 len: 1328 microversion: 2.1 time: 0.117449 May 31 18:35:24.034656 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 441/870] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:23 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 1328 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:24.834803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:24.835417 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:24.842871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:24.843313 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:24.844078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:24.844538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:25.052757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:25.053302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:25.061493 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:25.061989 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:25.063345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:25.063345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:25.080372 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] HTTP exception thrown: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Request method failure captured: May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 HTTP/1.1 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16wEZ3LsqX3zhvChS-LwShZyC_XbOelHhICwKNldMUvXdJqOGRhszIp3gMwUbiufsGnFUHzZlUXhdk72Cs38TKZ4HtG1-PmvLOjcHiTZXkzNfI1F9TCeiyT0FuhbtiNutrFA3Eas1pC3KjObKc9TQwZbeTTOdzxVycz3JED4Ct-r8 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:25.082141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea083067dfc4b6194457652a3501317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea083067dfc4b6194457652a3501317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 7c6d1ac15d024f77bb363170ab423c0b May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:25.083732 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'f10c2fd8-42b0-446b-b4b6-27225c87e822'} May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:25.087914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:25.089409 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:25.091418 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Returning 404 to user: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:25.091418 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7d842d2b-c8c6-4c9f-9150-f3e8c5f38050 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 404 len: 111 microversion: 2.1 time: 0.035495 May 31 18:35:25.091418 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 442/871] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:25 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:35:25.093210 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-75bcc92b-a1f4-4ee3-8aaa-a0459ffa8b9f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '.version_select at 0x7ffb78a64670>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:25.111620 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-75bcc92b-a1f4-4ee3-8aaa-a0459ffa8b9f tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871324145" status: 202 len: 0 microversion: 2.1 time: 0.022976 May 31 18:35:25.112235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 443/872] 10.222.0.17 () {58 vars in 1220 bytes} [Tue May 31 18:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1871324145 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:35:25.309666 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:25.321349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:25.323249 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:25.325422 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-44babdbd-eb39-4e27-842d-cdb414c0e18b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.493819 May 31 18:35:25.326365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 430/873] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:24 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:26.346197 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:26.346946 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:26.354059 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:26.354591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:26.355455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:26.356818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:26.506243 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:26.515626 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:26.517533 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:26.518791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5dcc9acc-5e36-4fc2-81ab-63f5a0f1ce08 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.178503 May 31 18:35:26.519440 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 444/874] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:26 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:27.538185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:27.538792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:27.546163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:27.546606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:27.547376 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:27.547806 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:27.689250 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:27.697728 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:27.699237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:27.700896 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7a31bc48-39e1-49a2-95bd-693653cc3872 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.166498 May 31 18:35:27.701464 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 431/875] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:27 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:28.015319 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:28.015885 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:28.022667 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:28.023115 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:28.023883 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:28.024350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:28.040276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] HTTP exception thrown: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Request method failure captured: May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 HTTP/1.1 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16wEZ3LsqX3zhvChS-LwShZyC_XbOelHhICwKNldMUvXdJqOGRhszIp3gMwUbiufsGnFUHzZlUXhdk72Cs38TKZ4HtG1-PmvLOjcHiTZXkzNfI1F9TCeiyT0FuhbtiNutrFA3Eas1pC3KjObKc9TQwZbeTTOdzxVycz3JED4Ct-r8 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:28.042092 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea083067dfc4b6194457652a3501317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea083067dfc4b6194457652a3501317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 7c6d1ac15d024f77bb363170ab423c0b May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.044404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'f10c2fd8-42b0-446b-b4b6-27225c87e822'} May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:28.045545 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.046969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:28.049194 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Returning 404 to user: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:28.050375 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-157ab872-294e-41e1-9d3a-c780391dbfc0 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 404 len: 111 microversion: 2.1 time: 0.040244 May 31 18:35:28.052236 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 445/876] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:35:28 2022] DELETE /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:35:28.069134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:28.069774 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: f10c2fd8-42b0-446b-b4b6-27225c87e822] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:28.078049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:28.078819 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:28.079841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:28.080530 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:28.084374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:28.112795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] HTTP exception thrown: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Request method failure captured: May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 HTTP/1.1 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16wEZ3LsqX3zhvChS-LwShZyC_XbOelHhICwKNldMUvXdJqOGRhszIp3gMwUbiufsGnFUHzZlUXhdk72Cs38TKZ4HtG1-PmvLOjcHiTZXkzNfI1F9TCeiyT0FuhbtiNutrFA3Eas1pC3KjObKc9TQwZbeTTOdzxVycz3JED4Ct-r8 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:35:28.114761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea083067dfc4b6194457652a3501317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea083067dfc4b6194457652a3501317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 7c6d1ac15d024f77bb363170ab423c0b May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.116167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'f10c2fd8-42b0-446b-b4b6-27225c87e822'} May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:28.116935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. May 31 18:35:28.118234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:28.119341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Returning 404 to user: Instance f10c2fd8-42b0-446b-b4b6-27225c87e822 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:28.119341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3e823f07-0ba5-46b9-a9a2-504ee8a5f9db tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822" status: 404 len: 111 microversion: 2.1 time: 0.061737 May 31 18:35:28.120003 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 432/877] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:28 2022] GET /compute/v2.1/servers/f10c2fd8-42b0-446b-b4b6-27225c87e822 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:35:28.719520 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:28.720151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:28.726466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:28.727166 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:28.728160 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:28.728602 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:28.867695 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:28.877912 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:28.879432 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:28.881350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-65224cb2-a2f0-426f-8a5a-d0d1a97ecd22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.166324 May 31 18:35:28.882094 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 446/878] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:28 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:29.264337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:29.264895 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:29.272406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:29.272852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:29.273672 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:29.274053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:29.289268 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] HTTP exception thrown: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Request method failure captured: May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 HTTP/1.1 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16wEZ3LsqX3zhvChS-LwShZyC_XbOelHhICwKNldMUvXdJqOGRhszIp3gMwUbiufsGnFUHzZlUXhdk72Cs38TKZ4HtG1-PmvLOjcHiTZXkzNfI1F9TCeiyT0FuhbtiNutrFA3Eas1pC3KjObKc9TQwZbeTTOdzxVycz3JED4Ct-r8 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:35:29.290830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea083067dfc4b6194457652a3501317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea083067dfc4b6194457652a3501317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 7c6d1ac15d024f77bb363170ab423c0b May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.292211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'ad9cc87a-c08b-48eb-9014-e1a997cd84d7'} May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:29.292911 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.294523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:29.295814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Returning 404 to user: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:29.295814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4f079ffc-c7f2-41da-9937-c6fdca634a50 tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 404 len: 111 microversion: 2.1 time: 0.032564 May 31 18:35:29.295814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 433/879] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:35:29 2022] DELETE /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:35:29.301489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:29.302669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] [instance: ad9cc87a-c08b-48eb-9014-e1a997cd84d7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:29.309886 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:29.310542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:29.311317 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:29.311752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:29.326331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] HTTP exception thrown: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Request method failure captured: May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 HTTP/1.1 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16wEZ3LsqX3zhvChS-LwShZyC_XbOelHhICwKNldMUvXdJqOGRhszIp3gMwUbiufsGnFUHzZlUXhdk72Cs38TKZ4HtG1-PmvLOjcHiTZXkzNfI1F9TCeiyT0FuhbtiNutrFA3Eas1pC3KjObKc9TQwZbeTTOdzxVycz3JED4Ct-r8 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:29.327920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_7ea083067dfc4b6194457652a3501317"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/7ea083067dfc4b6194457652a3501317"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/7ea083067dfc4b6194457652a3501317"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 7ea083067dfc4b6194457652a3501317 May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-480748412 May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 7c6d1ac15d024f77bb363170ab423c0b May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeTestJSON-480748412-project May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.329291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'ad9cc87a-c08b-48eb-9014-e1a997cd84d7'} May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:29.329990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. May 31 18:35:29.331131 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:29.332173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] Returning 404 to user: Instance ad9cc87a-c08b-48eb-9014-e1a997cd84d7 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:29.332173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-dcf6f534-dc83-4c81-882d-51eb6dc4e8ee tempest-AttachVolumeTestJSON-480748412 tempest-AttachVolumeTestJSON-480748412-project] 10.222.0.17 "GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7" status: 404 len: 111 microversion: 2.1 time: 0.031730 May 31 18:35:29.332173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 447/880] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:29 2022] GET /compute/v2.1/servers/ad9cc87a-c08b-48eb-9014-e1a997cd84d7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:35:29.900812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:29.901343 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:29.909028 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:29.909446 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:29.910236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:29.910667 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:30.070608 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:30.086045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:30.087537 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:30.088786 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5bf4af59-3fe3-4aea-a051-73338fb8c87e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.192341 May 31 18:35:30.100319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 434/881] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:29 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:31.108023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:31.109451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:31.123385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:31.123829 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:31.125660 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:31.126100 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:31.332432 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:31.342562 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:31.344073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:31.353015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8bb41cff-e8ff-462c-85fb-ad3b17936a62 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.249689 May 31 18:35:31.353501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 448/882] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:31 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:32.376462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:32.377843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:32.392763 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:32.394066 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:32.395071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:32.400199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:32.662745 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:32.678493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:32.680691 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:32.682364 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e1d79b22-39d2-4406-ac5a-12fe99ab14f7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.309660 May 31 18:35:32.693365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 435/883] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:32 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:33.703119 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:33.704504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:33.713026 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:33.713634 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:33.714544 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:33.715246 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:33.909863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:33.928753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:33.935422 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:33.936911 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7c94972f-49ab-45d9-8e7b-64b79e8255d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.240061 May 31 18:35:33.937663 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 449/884] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:33 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:34.956004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:34.956677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:34.964015 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:34.964517 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:34.965439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:34.966202 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:35.106214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:35.114949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:35.116523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:35.117681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cdde558f-16c4-4ca0-b87c-18fc51f78ee3 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.166025 May 31 18:35:35.118224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 436/885] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:34 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:36.137797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:36.141325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:36.151751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:36.152210 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:36.153724 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:36.154403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:36.168511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c8062e72-1676-422b-9741-6d2a4e52d6d5 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb741e5c10>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:36.220300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c8062e72-1676-422b-9741-6d2a4e52d6d5 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/1303d875-cec1-4b30-a665-0e7eed253550" status: 200 len: 350 microversion: 2.1 time: 0.055799 May 31 18:35:36.221134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 437/886] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:35:36 2022] GET /compute/v2.1/os-volumes/1303d875-cec1-4b30-a665-0e7eed253550 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:36.302366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:36.312586 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:36.314226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:36.315476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cf6be1b0-5f41-4d03-a759-792835927e99 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.183139 May 31 18:35:36.316327 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 450/887] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:36 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:37.334723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:37.335334 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:37.342320 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:37.342768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:37.343525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:37.343958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:37.477427 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:37.486633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:37.488141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:37.489284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-372b5156-e327-42c8-b325-7631344e0f3d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.158965 May 31 18:35:37.489827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 438/888] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:37 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:38.509242 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:38.509858 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:38.516884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:38.517515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:38.518323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:38.518752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:38.623182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-75b989d6-08da-4698-a87f-f5f15e2a8b01 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb741863a0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:38.658761 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:38.666945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:38.669143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:38.670343 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-10c79f19-c16e-47b7-af07-eaba1165bc07 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.165771 May 31 18:35:38.675946 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 451/889] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:38 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:38.676108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-75b989d6-08da-4698-a87f-f5f15e2a8b01 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/884ba8d7-41b8-44a0-90d5-704800d01cb1" status: 200 len: 350 microversion: 2.1 time: 0.054276 May 31 18:35:38.676108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 439/890] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:35:38 2022] GET /compute/v2.1/os-volumes/884ba8d7-41b8-44a0-90d5-704800d01cb1 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:35:39.693058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:39.693613 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:39.700601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:39.701045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:39.701810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:39.702245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:39.830821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:39.839116 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:39.841231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:39.842384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-be09c925-6686-49ce-8581-d9a5a70a5f7b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.153345 May 31 18:35:39.842931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 452/891] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:39 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:40.001903 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d3d6e7ca-3182-4112-ae63-d6dac9aa0e77 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb74206af0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.048517 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d3d6e7ca-3182-4112-ae63-d6dac9aa0e77 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/02c74412-ca59-4fa8-9d33-1b5395ba3e41" status: 200 len: 350 microversion: 2.1 time: 0.050878 May 31 18:35:40.049085 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 440/892] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:35:39 2022] GET /compute/v2.1/os-volumes/02c74412-ca59-4fa8-9d33-1b5395ba3e41 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:40.060830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1571113b-4527-493b-8938-b3a2d9820f1e tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb740a4dc0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.143340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1571113b-4527-493b-8938-b3a2d9820f1e tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.086939 May 31 18:35:40.144023 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 453/893] 10.222.0.17 () {58 vars in 1133 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:40.155901 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f033cad6-a47e-494b-a982-675db3793836 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb74169820>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.268920 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f033cad6-a47e-494b-a982-675db3793836 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.116708 May 31 18:35:40.269710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 441/894] 10.222.0.17 () {58 vars in 1148 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:40.281766 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7781c9f6-ca69-41ce-8433-2cbc93234099 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb78a64310>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.362254 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7781c9f6-ca69-41ce-8433-2cbc93234099 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.084352 May 31 18:35:40.362817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 454/895] 10.222.0.17 () {58 vars in 1133 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:40.374734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-41fc40a3-266b-430d-a66a-c594567c2c7c tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb741695e0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.455515 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-41fc40a3-266b-430d-a66a-c594567c2c7c tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084929 May 31 18:35:40.456078 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 442/896] 10.222.0.17 () {58 vars in 1166 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:40.468004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f5c68931-88cf-4809-bb14-2dbd08e02776 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb741f90d0>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.550295 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f5c68931-88cf-4809-bb14-2dbd08e02776 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.086591 May 31 18:35:40.550947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 455/897] 10.222.0.17 () {58 vars in 1169 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:40.563764 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-85065da0-946f-4058-b8d8-b488c35a9b69 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb74001160>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.644774 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-85065da0-946f-4058-b8d8-b488c35a9b69 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085129 May 31 18:35:40.645344 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 443/898] 10.222.0.17 () {58 vars in 1154 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:40.657018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-633159c1-4121-4af4-a6cb-656cc6abd10b tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb78a10a60>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.742998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-633159c1-4121-4af4-a6cb-656cc6abd10b tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090280 May 31 18:35:40.743596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 456/899] 10.222.0.17 () {58 vars in 1187 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:35:40.754952 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f631e22d-3eb1-4312-9396-936bff8ae1f2 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] Calling method '.version_select at 0x7ffb6ef050d0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.836349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f631e22d-3eb1-4312-9396-936bff8ae1f2 tempest-VolumesTestJSON-1958301086 tempest-VolumesTestJSON-1958301086-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.085071 May 31 18:35:40.836945 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 444/900] 10.222.0.17 () {58 vars in 1154 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:40.860667 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:40.861292 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:40.867757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:40.868244 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:40.869019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:40.869462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:41.011645 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:41.020339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:41.021831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:41.022975 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-71b9c4e7-15b8-415f-9f78-e022b6b0b88e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.166177 May 31 18:35:41.023516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 457/901] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:40 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:42.041912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:42.042601 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:42.049233 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:42.049684 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:42.050446 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:42.050896 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:42.186953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:42.195197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:42.196718 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:42.197865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-463a9177-bf4c-4931-ad69-3ff858bb1e45 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.160644 May 31 18:35:42.198412 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 445/902] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:42 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:42.849915 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:42.850406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:42.856619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:42.857064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:42.857828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:42.858264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:42.880762 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-29cbf46b-657d-47fa-bca3-0a2cc3d55cf5 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/ips" status: 200 len: 150 microversion: 2.1 time: 0.232436 May 31 18:35:42.881306 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 458/903] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:35:42 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/ips => generated 150 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:43.216792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:43.217400 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:43.223939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:43.224421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:43.225185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:43.225619 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:43.356853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:43.365171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:43.366686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:43.367853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0017fc6e-1b1c-40da-8553-19aa77e9e56c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.155713 May 31 18:35:43.368442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 446/904] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:43 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:44.207047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a5f50a0-a7db-4b64-a3a9-202e9aab72d5"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:44.208190 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:44.214657 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:44.215880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:44.216666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:44.217096 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:44.388754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:44.389369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:44.396930 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:44.397808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:44.398654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:44.399317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:44.529786 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0de17149-8981-4886-8815-5fae14c40fde tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "POST /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.326423 May 31 18:35:44.530742 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 459/905] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:35:44 2022] POST /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments => generated 194 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:44.555630 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:44.565308 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:44.566926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:44.568050 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fe72d27c-7104-4b26-880a-a712f07b39eb tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.184765 May 31 18:35:44.568617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 447/906] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:44 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:35:45.587284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:45.587893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:45.596790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:45.597580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:45.599009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:45.599009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:45.742034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:45.744031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4499f20e-b147-47b8-bb51-b25d7713fc2e tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Action: 'create', calling method: .version_select at 0x7ffb74083af0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2045088188", "metadata": {"Type": "work"}}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:45.751403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:45.753087 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4499f20e-b147-47b8-bb51-b25d7713fc2e tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Request method failure captured: May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 122 May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABilmABfEpdLQM_M0OqKP1E1q4d1tXpVz83rhXxzYhAd7ENXl8opd6kUubTFB6OA7w30SkDTrD-3buv-jl2mxpTkPcGnp4RElgLdBCyHsD3FT0cNisMH5GKIrvbDzhmbxoGzMaMXNsx2m0R_yMnBqRtDs9zeuBqX28DvWkE0pH_A_pb0zA May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:35:45.753410 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 120cea05ee014ca8a9efb7c36fdcee91 May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2045088188", "metadata": {"Type": "work"}}} May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: May 31 18:35:45.754986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2045088188', 'metadata': {'Type': 'work'}}}} May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise error May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi '#$%' May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:45.756402 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 18:35:45.758086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 18:35:45.759444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 18:35:45.759444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.759609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8c7bb605-701a-473d-ade4-88465db68057 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.171332 May 31 18:35:45.759804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4499f20e-b147-47b8-bb51-b25d7713fc2e tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:45.759904 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 460/907] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:45 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:45.760922 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4499f20e-b147-47b8-bb51-b25d7713fc2e tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137951 May 31 18:35:45.761471 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 448/908] 10.222.0.17 () {60 vars in 1155 bytes} [Tue May 31 18:35:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 18:35:45.770517 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7c0be307-3ae4-4cd1-8269-f9252754e608 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Action: 'create', calling method: .version_select at 0x7ffb74092940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2009642307", "metadata": {"Type": "work"}}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7c0be307-3ae4-4cd1-8269-f9252754e608 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Request method failure captured: May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 120 May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmABfEpdLQM_M0OqKP1E1q4d1tXpVz83rhXxzYhAd7ENXl8opd6kUubTFB6OA7w30SkDTrD-3buv-jl2mxpTkPcGnp4RElgLdBCyHsD3FT0cNisMH5GKIrvbDzhmbxoGzMaMXNsx2m0R_yMnBqRtDs9zeuBqX28DvWkE0pH_A_pb0zA May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:45.774165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 120cea05ee014ca8a9efb7c36fdcee91 May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2009642307", "metadata": {"Type": "work"}}} May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: May 31 18:35:45.775679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2009642307', 'metadata': {'Type': 'work'}}}} May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise error May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi '0' May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:45.776651 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 18:35:45.778188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 18:35:45.779518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 18:35:45.779518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.779518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7c0be307-3ae4-4cd1-8269-f9252754e608 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:45.779518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7c0be307-3ae4-4cd1-8269-f9252754e608 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008995 May 31 18:35:45.779518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 461/909] 10.222.0.17 () {60 vars in 1155 bytes} [Tue May 31 18:35:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 31 18:35:45.784766 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3a6157da-db43-4e8a-ae30-70053ebbc111 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Action: 'create', calling method: .version_select at 0x7ffb742069d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-214641268", "metadata": {"Type": "work"}}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3a6157da-db43-4e8a-ae30-70053ebbc111 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Request method failure captured: May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 118 May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABilmABfEpdLQM_M0OqKP1E1q4d1tXpVz83rhXxzYhAd7ENXl8opd6kUubTFB6OA7w30SkDTrD-3buv-jl2mxpTkPcGnp4RElgLdBCyHsD3FT0cNisMH5GKIrvbDzhmbxoGzMaMXNsx2m0R_yMnBqRtDs9zeuBqX28DvWkE0pH_A_pb0zA May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:35:45.787009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 120cea05ee014ca8a9efb7c36fdcee91 May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-214641268", "metadata": {"Type": "work"}}} May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: May 31 18:35:45.788565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-214641268', 'metadata': {'Type': 'work'}}}} May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise error May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi '' May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:45.790123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 18:35:45.791698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 18:35:45.793544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 18:35:45.793544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.793544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3a6157da-db43-4e8a-ae30-70053ebbc111 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:45.793544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3a6157da-db43-4e8a-ae30-70053ebbc111 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007301 May 31 18:35:45.793544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 449/910] 10.222.0.17 () {60 vars in 1155 bytes} [Tue May 31 18:35:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 18:35:45.797999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f37d0162-4795-40ad-b05e-d58ecf73528f tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Calling method '.version_select at 0x7ffb741d1040>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:45.825550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-f37d0162-4795-40ad-b05e-d58ecf73528f tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] HTTP exception thrown: Volume tempest-invalid-1552772749 could not be found. May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f37d0162-4795-40ad-b05e-d58ecf73528f tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Request method failure captured: May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1552772749 HTTP/1.1 May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmABfEpdLQM_M0OqKP1E1q4d1tXpVz83rhXxzYhAd7ENXl8opd6kUubTFB6OA7w30SkDTrD-3buv-jl2mxpTkPcGnp4RElgLdBCyHsD3FT0cNisMH5GKIrvbDzhmbxoGzMaMXNsx2m0R_yMnBqRtDs9zeuBqX28DvWkE0pH_A_pb0zA May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:45.828262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 120cea05ee014ca8a9efb7c36fdcee91 May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Volume tempest-invalid-1552772749 could not be found. May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'tempest-invalid-1552772749'} May 31 18:35:45.829763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1552772749 could not be found. (HTTP 404) (Request-ID: req-00c0eeab-0676-4036-a60f-c4f45a30c205) May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.834492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 18:35:45.835862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1552772749 could not be found. May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:45.837264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1552772749 could not be found. May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1552772749 could not be found. May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f37d0162-4795-40ad-b05e-d58ecf73528f tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Returning 404 to user: Volume tempest-invalid-1552772749 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f37d0162-4795-40ad-b05e-d58ecf73528f tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1552772749" status: 404 len: 99 microversion: 2.1 time: 0.035275 May 31 18:35:45.838716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 462/911] 10.222.0.17 () {58 vars in 1217 bytes} [Tue May 31 18:35:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1552772749 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 31 18:35:45.839687 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9262b8e4-3a1e-40d3-8b43-9d18f197718f tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004508 May 31 18:35:45.840840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 450/912] 10.222.0.17 () {58 vars in 1139 bytes} [Tue May 31 18:35:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 31 18:35:45.848677 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d9e73ccf-54b4-4721-9823-dada148e6f79 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003560 May 31 18:35:45.849146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 463/913] 10.222.0.17 () {58 vars in 1136 bytes} [Tue May 31 18:35:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 31 18:35:45.857543 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6c598358-5546-4d03-8dba-1685a97cae40 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Calling method '.version_select at 0x7ffb74206a60>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:45.885679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-6c598358-5546-4d03-8dba-1685a97cae40 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] HTTP exception thrown: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6c598358-5546-4d03-8dba-1685a97cae40 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Request method failure captured: May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: DELETE /compute/v2.1/os-volumes/44b5abd3-d513-4de0-9b53-fd708ab3f487 HTTP/1.1 May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABilmABfEpdLQM_M0OqKP1E1q4d1tXpVz83rhXxzYhAd7ENXl8opd6kUubTFB6OA7w30SkDTrD-3buv-jl2mxpTkPcGnp4RElgLdBCyHsD3FT0cNisMH5GKIrvbDzhmbxoGzMaMXNsx2m0R_yMnBqRtDs9zeuBqX28DvWkE0pH_A_pb0zA May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:35:45.887679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 120cea05ee014ca8a9efb7c36fdcee91 May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '44b5abd3-d513-4de0-9b53-fd708ab3f487'} May 31 18:35:45.889194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. (HTTP 404) (Request-ID: req-bac1fbbb-f566-4b67-98a8-c6e09244eb9a) May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.890139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 18:35:45.891495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 18:35:45.892832 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6c598358-5546-4d03-8dba-1685a97cae40 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Returning 404 to user: Volume 44b5abd3-d513-4de0-9b53-fd708ab3f487 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6c598358-5546-4d03-8dba-1685a97cae40 tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "DELETE /compute/v2.1/os-volumes/44b5abd3-d513-4de0-9b53-fd708ab3f487" status: 404 len: 109 microversion: 2.1 time: 0.035704 May 31 18:35:45.894053 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 451/914] 10.222.0.17 () {58 vars in 1247 bytes} [Tue May 31 18:35:45 2022] DELETE /compute/v2.1/os-volumes/44b5abd3-d513-4de0-9b53-fd708ab3f487 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:35:45.899976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-225c0b06-2f3e-4ad5-bc41-7878946adb3d tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Calling method '.version_select at 0x7ffb741a8c10>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:45.927108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-225c0b06-2f3e-4ad5-bc41-7878946adb3d tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] HTTP exception thrown: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-225c0b06-2f3e-4ad5-bc41-7878946adb3d tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Request method failure captured: May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/os-volumes/c115d331-5bc8-4135-953a-ae4aa6053ad8 HTTP/1.1 May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmABfEpdLQM_M0OqKP1E1q4d1tXpVz83rhXxzYhAd7ENXl8opd6kUubTFB6OA7w30SkDTrD-3buv-jl2mxpTkPcGnp4RElgLdBCyHsD3FT0cNisMH5GKIrvbDzhmbxoGzMaMXNsx2m0R_yMnBqRtDs9zeuBqX28DvWkE0pH_A_pb0zA May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:45.929086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f7c6db8a718a4370bd4131fc722e225a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: f7c6db8a718a4370bd4131fc722e225a May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesNegativeTest-302028013 May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 120cea05ee014ca8a9efb7c36fdcee91 May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesNegativeTest-302028013-project May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'c115d331-5bc8-4135-953a-ae4aa6053ad8'} May 31 18:35:45.930604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. (HTTP 404) (Request-ID: req-6ce93a25-068e-44cd-b517-04035afff706) May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.931692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 18:35:45.933088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 18:35:45.935265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-225c0b06-2f3e-4ad5-bc41-7878946adb3d tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] Returning 404 to user: Volume c115d331-5bc8-4135-953a-ae4aa6053ad8 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-225c0b06-2f3e-4ad5-bc41-7878946adb3d tempest-VolumesNegativeTest-302028013 tempest-VolumesNegativeTest-302028013-project] 10.222.0.17 "GET /compute/v2.1/os-volumes/c115d331-5bc8-4135-953a-ae4aa6053ad8" status: 404 len: 109 microversion: 2.1 time: 0.035002 May 31 18:35:45.936633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 464/915] 10.222.0.17 () {58 vars in 1244 bytes} [Tue May 31 18:35:45 2022] GET /compute/v2.1/os-volumes/c115d331-5bc8-4135-953a-ae4aa6053ad8 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:35:46.773165 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:46.773826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:46.776244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=44 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:46.782237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:46.782685 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:46.783796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:46.783948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:46.919236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:46.930029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:46.931546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:46.932751 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-00d87c0c-4339-4e0c-99c8-79fecec5c8da tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.164211 May 31 18:35:46.933306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 452/916] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:46 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:47.952250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:47.953451 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:47.959663 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:47.960151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:47.960931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:47.961394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:48.101502 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:48.111247 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:48.112763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:48.113918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e63d856e-4e55-4c04-b015-4ddf2d2f07f5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.167183 May 31 18:35:48.114461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 465/917] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:47 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:49.132261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:49.132870 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:49.141350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:49.141926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:49.142866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:49.143349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:49.288802 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:49.297673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:49.299177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:49.300382 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-60c789fd-b6b6-4f2e-b7fa-8459edb4c61e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.172280 May 31 18:35:49.300963 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 453/918] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:49 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:50.320015 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:50.320688 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:50.323200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:50.333700 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:50.334154 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:50.335056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:50.335393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:50.478299 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:50.487879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:50.489461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:50.490625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ae98f347-dd0a-43a4-92e7-f853c4bf2be8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.174936 May 31 18:35:50.491177 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 466/919] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:50 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:50.930008 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-ea07d253-566d-43a0-bd9e-1786aff300ed req-e18635eb-d691-4cbd-8f96-ee14be0b7711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "name": "network-vif-plugged", "status": "completed", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:50.941307 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ea07d253-566d-43a0-bd9e-1786aff300ed req-e18635eb-d691-4cbd-8f96-ee14be0b7711 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:50.942192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ea07d253-566d-43a0-bd9e-1786aff300ed req-e18635eb-d691-4cbd-8f96-ee14be0b7711 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:50.966568 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-ea07d253-566d-43a0-bd9e-1786aff300ed req-e18635eb-d691-4cbd-8f96-ee14be0b7711 service nova] Creating event network-vif-plugged:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:35:50.972486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-ea07d253-566d-43a0-bd9e-1786aff300ed req-e18635eb-d691-4cbd-8f96-ee14be0b7711 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046485 May 31 18:35:50.973500 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 454/920] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:35:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:51.509566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:51.510158 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:51.518005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:51.518448 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:51.519215 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:51.519643 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:51.661598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:51.664933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:51.671934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:51.673452 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:51.674608 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c98d91c9-dc1d-44ec-8a8d-a27b204aabe7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.169173 May 31 18:35:51.675154 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 467/921] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:51 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:52.694856 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:52.695725 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:52.702205 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:52.702655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:52.703418 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:52.703926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:52.837500 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:52.856401 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:52.858289 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:52.859734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1f2ffaf6-c5e5-44fe-ac45-5100a3d55064 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.169633 May 31 18:35:52.860920 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 455/922] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:52 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:53.878284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:53.879237 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:53.897837 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:53.898508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:53.899284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:53.900162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:54.062572 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:54.075959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:54.086957 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:54.088842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-31c33d62-d3c4-4c41-bc3d-7562c657e10c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1808 microversion: 2.20 time: 0.214831 May 31 18:35:54.089692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 468/923] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:53 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1808 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:54.341107 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:54.341505 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:54.348467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:54.348812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:54.349774 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:54.350508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:54.453642 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lazy-loading 'services' on Instance uuid 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:35:54.540451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c59cb5ce-1805-4a63-9a32-46fc83401882 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments/2a5f50a0-a7db-4b64-a3a9-202e9aab72d5" status: 202 len: 0 microversion: 2.1 time: 0.204705 May 31 18:35:54.541399 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 456/924] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:35:54 2022] DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments/2a5f50a0-a7db-4b64-a3a9-202e9aab72d5 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:35:54.551807 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:54.553142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:54.560841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:54.562206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:54.563193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:54.563632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:54.594755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-95203947-f17a-4c63-a3f3-7e3e7faa01cf tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047374 May 31 18:35:54.595319 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 469/925] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:35:54 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:55.112551 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:55.113348 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:55.119605 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.120199 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.121806 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.122560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.268778 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:55.277362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:55.278904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:55.280138 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1be2539b-b831-4f86-91f6-87d760cfbe14 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1795 microversion: 2.20 time: 0.171998 May 31 18:35:55.280697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 457/926] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:35:55 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1795 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:35:55.608674 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:55.610061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:55.618473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.618940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.619720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.620465 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.663464 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-79328100-18be-4f96-87fd-a08b7c47a481 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060928 May 31 18:35:55.664422 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 470/927] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:35:55 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 18:35:55.737966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:55.738507 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:55.745005 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.745451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.746975 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.747690 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.787391 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:35:55.879863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-62670f75-3a28-4bbe-9adc-1dfebbe32513 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 204 len: 0 microversion: 2.1 time: 0.145121 May 31 18:35:55.880741 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 458/928] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:35:55 2022] DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:35:55.895661 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:55.896573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:55.904542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.905041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:55.905808 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:55.906241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:56.057311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:56.065564 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bcf259d1-4466-44cd-a7de-1b7cace02d52 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1682 microversion: 2.1 time: 0.178793 May 31 18:35:56.066335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 471/929] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:55 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:57.084378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:57.085091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:57.092609 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:57.093100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:57.093877 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:57.094314 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:57.110729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:35:57.240488 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:57.249596 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-eadbe656-17a0-4a80-9d8f-eb03949cd107 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1682 microversion: 2.1 time: 0.169641 May 31 18:35:57.250255 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 459/930] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:57 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:58.269543 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:58.270621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:58.277602 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:58.278226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:58.279251 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:58.279554 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:58.384970 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2b7c2402a774a88ba6c15a2adcd5bd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc148ca451e24f97aecc883782f1ef9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:35:58.401220 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0dd5e1a8-3b8c-491e-8d55-d349cccd4b09 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 200 len: 1614 microversion: 2.1 time: 0.136942 May 31 18:35:58.403541 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 472/931] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:58 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 1614 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:35:58.849851 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-abad36de-28e5-4c32-842c-00493abcc060 req-1037d2f2-de78-4e65-86d3-98d1cac19588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11", "name": "network-vif-deleted", "tag": "3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:35:58.859143 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-abad36de-28e5-4c32-842c-00493abcc060 req-1037d2f2-de78-4e65-86d3-98d1cac19588 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:58.859593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-abad36de-28e5-4c32-842c-00493abcc060 req-1037d2f2-de78-4e65-86d3-98d1cac19588 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:58.876226 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-abad36de-28e5-4c32-842c-00493abcc060 req-1037d2f2-de78-4e65-86d3-98d1cac19588 service nova] Creating event network-vif-deleted:3941e21c-5c3b-4b30-8bb2-4a27aa7b91e1 for instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 on hv-cinder-83979 May 31 18:35:58.881673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-abad36de-28e5-4c32-842c-00493abcc060 req-1037d2f2-de78-4e65-86d3-98d1cac19588 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208797 May 31 18:35:58.882275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 460/932] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:35:59.421596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:59.422211 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:35:59.428945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:59.429392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:59.430160 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:35:59.430590 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:35:59.444719 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 HTTP/1.1 May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:35:59.446266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:35:59.447704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11'} May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:35:59.448691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:35:59.451444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:35:59.453673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:35:59.453673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5e8e9c3a-3578-4f9e-969a-edf06b1b6125 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 404 len: 111 microversion: 2.1 time: 0.031046 May 31 18:35:59.453673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 473/933] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:35:59 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:35:59.459535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d21cfcf8-e617-4bfe-a029-d0b32d8cf6b2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '.version_select at 0x7ffb742064c0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:35:59.478219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d21cfcf8-e617-4bfe-a029-d0b32d8cf6b2 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504916591" status: 202 len: 0 microversion: 2.1 time: 0.022875 May 31 18:35:59.478807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 461/934] 10.222.0.17 () {58 vars in 1220 bytes} [Tue May 31 18:35:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1504916591 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:36:01.283958 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:01.284475 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:01.290934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:01.291384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:01.292179 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:01.292621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:01.306790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 HTTP/1.1 May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:36:01.308486 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.309842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11'} May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:01.310604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.312061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:01.313552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:01.313552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a142f87a-3e72-4143-a30a-20baa8f6d9c6 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 404 len: 111 microversion: 2.1 time: 0.029748 May 31 18:36:01.313552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 474/935] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:36:01 2022] DELETE /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:01.319261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:01.319992 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:01.326111 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:01.326559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:01.327316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:01.327758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:01.342348 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 HTTP/1.1 May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:36:01.344032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.345570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11'} May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:01.346513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. May 31 18:36:01.348047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:01.349859 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance 84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:01.349859 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-227bef74-a1ad-4c94-af47-b5ac0b47bb9a tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11" status: 404 len: 111 microversion: 2.1 time: 0.030546 May 31 18:36:01.349859 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 462/936] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:01 2022] GET /compute/v2.1/servers/84d3d7e9-32c6-4b08-a39c-ef2e9ab4ae11 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:02.481020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:02.481524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:02.487976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.488504 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.489274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.489714 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.503034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 HTTP/1.1 May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:36:02.504591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.506297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'cf09a33d-5fae-4b44-929f-9423be34f7c5'} May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:02.507174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.508671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.509960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:02.509960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bc35a79c-1de8-4a0d-97b5-cf25af3d1a14 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 404 len: 111 microversion: 2.1 time: 0.029294 May 31 18:36:02.509960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 475/937] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:36:02 2022] DELETE /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:02.515249 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:02.515860 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cf09a33d-5fae-4b44-929f-9423be34f7c5] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:02.522214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.522657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.523415 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.523849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.537536 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 HTTP/1.1 May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:36:02.539036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.540696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'cf09a33d-5fae-4b44-929f-9423be34f7c5'} May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:02.541576 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. May 31 18:36:02.543258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.553031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance cf09a33d-5fae-4b44-929f-9423be34f7c5 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:02.553031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4b14dd11-a417-4c1e-942f-a26f5e4b7de9 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5" status: 404 len: 111 microversion: 2.1 time: 0.029660 May 31 18:36:02.553031 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 463/938] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:02 2022] GET /compute/v2.1/servers/cf09a33d-5fae-4b44-929f-9423be34f7c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:36:02.553312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:02.553312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:02.556969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.557540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.558831 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.559276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.572997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e HTTP/1.1 May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:36:02.575396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.576801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '635bcc80-e6b1-4b95-aefb-4aa155a59f4e'} May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:02.577548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.578737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:02.579933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:02.579933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a7ac7524-7226-4231-8db4-fc846542ed6c tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 404 len: 111 microversion: 2.1 time: 0.031893 May 31 18:36:02.579933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 476/939] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:36:02 2022] DELETE /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:36:02.585166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:02.585779 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: 635bcc80-e6b1-4b95-aefb-4aa155a59f4e] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:02.591921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.592351 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.593110 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:02.593546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:02.607094 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e HTTP/1.1 May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:36:02.608633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.610236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '635bcc80-e6b1-4b95-aefb-4aa155a59f4e'} May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:02.611115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. May 31 18:36:02.612592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:02.613858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance 635bcc80-e6b1-4b95-aefb-4aa155a59f4e could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:02.613858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ca34e748-7e17-480a-81f0-83ce15a5d4f1 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e" status: 404 len: 111 microversion: 2.1 time: 0.028639 May 31 18:36:02.613858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 464/940] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:02 2022] GET /compute/v2.1/servers/635bcc80-e6b1-4b95-aefb-4aa155a59f4e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:03.742718 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:03.743222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:03.749725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:03.750126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:03.750895 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:03.751335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:03.766005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d HTTP/1.1 May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:36:03.767588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.769155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'cdb08f80-5f98-4bb9-a683-73f38dfaeb6d'} May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:03.769963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.771390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:36:03.773737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:03.773737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ca0a6b48-790e-400f-982d-24272e970737 tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 404 len: 111 microversion: 2.1 time: 0.030278 May 31 18:36:03.773737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 477/941] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:36:03 2022] DELETE /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:03.778857 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:03.779467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] [instance: cdb08f80-5f98-4bb9-a683-73f38dfaeb6d] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:03.785904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:03.786350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:03.787106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:03.787542 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:03.800932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] HTTP exception thrown: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Request method failure captured: May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d HTTP/1.1 May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill16CnqEymb_HlvwhKzuOBY9ZfMNBOEAM6laXMUaG8nCT2lUkN2v6j5Awt1vFgiYnCj4xtRyvbnOqtF5a4OOfNUoPnAxBxTt8jLDBMCjxMuj1Sfbryllfl1ZjLkn0tZPVN98LNeUZklEFljzTsYpsNTN6nvkQG7jbR0wi6vJGmeXjzQ May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:36:03.802440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/cc148ca451e24f97aecc883782f1ef9f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: cc148ca451e24f97aecc883782f1ef9f May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2032351073 May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: c2b7c2402a774a88ba6c15a2adcd5bd1 May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeNegativeTest-2032351073-project May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.803953 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'cdb08f80-5f98-4bb9-a683-73f38dfaeb6d'} May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:03.804928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. May 31 18:36:03.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:03.807732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] Returning 404 to user: Instance cdb08f80-5f98-4bb9-a683-73f38dfaeb6d could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:03.807732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-50336f2c-ecb1-4196-b65d-0a5eafc0b0be tempest-AttachVolumeNegativeTest-2032351073 tempest-AttachVolumeNegativeTest-2032351073-project] 10.222.0.17 "GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d" status: 404 len: 111 microversion: 2.1 time: 0.029582 May 31 18:36:03.807732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 465/942] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:03 2022] GET /compute/v2.1/servers/cdb08f80-5f98-4bb9-a683-73f38dfaeb6d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:10.198766 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:10.200113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:10.201274 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-ab799c90-cbf8-4772-8c3a-ee7fae68f840 req-d25d2cf3-8b87-42dd-b860-bb09284640c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:36:10.208713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:10.209558 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:10.210691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:10.211408 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:10.219038 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ab799c90-cbf8-4772-8c3a-ee7fae68f840 req-d25d2cf3-8b87-42dd-b860-bb09284640c4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:10.219511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ab799c90-cbf8-4772-8c3a-ee7fae68f840 req-d25d2cf3-8b87-42dd-b860-bb09284640c4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:10.241790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:36:10.247511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-ab799c90-cbf8-4772-8c3a-ee7fae68f840 req-d25d2cf3-8b87-42dd-b860-bb09284640c4 service nova] Creating event network-changed:1d0bca79-ab73-4643-a78f-e91fb3ea863b for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c on hv-cinder-83979 May 31 18:36:10.253867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-ab799c90-cbf8-4772-8c3a-ee7fae68f840 req-d25d2cf3-8b87-42dd-b860-bb09284640c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056728 May 31 18:36:10.258596 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 466/943] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:36:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:36:10.349916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b8ada616-05f0-45c2-b16a-9038b2f2adae tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "DELETE /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 204 len: 0 microversion: 2.1 time: 0.152876 May 31 18:36:10.350991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 478/944] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:36:10 2022] DELETE /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:36:10.360680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:10.361889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:10.369019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:10.369709 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:10.371746 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:10.372709 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:10.539668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:10.549994 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1fc65088-4c28-412e-9307-80bf1ffdbb97 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.193835 May 31 18:36:10.550752 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 467/945] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:10 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:11.569118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:11.569756 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:11.576750 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:11.577191 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:11.577945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:11.578373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:11.711598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:11.719771 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3ae17980-6395-4557-ae63-43c9e5309f92 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.154936 May 31 18:36:11.720348 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 479/946] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:11 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:12.737513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:12.738128 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:12.744180 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:12.744631 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:12.745389 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:12.745907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:12.874474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:12.882109 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3ea7e85c-9d39-4bff-9e0a-618abe199c4e tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.148653 May 31 18:36:12.882672 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 468/947] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:12 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:13.898716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:13.899331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:13.905889 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:13.906345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:13.907105 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:13.907542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:14.042715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:14.050430 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-84ff4c8e-f6d1-4d94-83e6-eed79b2d0444 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.155662 May 31 18:36:14.050983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 480/948] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:13 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:15.067090 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:15.067796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:15.074811 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:15.075331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:15.076232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:15.076651 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:15.214256 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:15.222434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a3b74c26-e2d3-4165-a70b-9cedc364e36c tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1570 microversion: 2.1 time: 0.159197 May 31 18:36:15.223006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 469/949] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:15 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:16.241178 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:16.242629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:16.249625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:16.250474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:16.251312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:16.252038 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:16.368108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:16.404916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2e27c1d2-b77f-4382-94aa-73d3aa0bb8f2 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1384 microversion: 2.1 time: 0.160755 May 31 18:36:16.404916 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 481/950] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:16 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1384 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:16.445139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-b593baba-57e1-451e-874b-a1f59383c774 req-dd3dfd8d-669c-4827-8528-612ecb7afb02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d640ec-d458-44c1-954e-3f1b66a0f79c", "name": "network-vif-deleted", "tag": "1d0bca79-ab73-4643-a78f-e91fb3ea863b"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:36:16.460766 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-b593baba-57e1-451e-874b-a1f59383c774 req-dd3dfd8d-669c-4827-8528-612ecb7afb02 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:16.461543 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-b593baba-57e1-451e-874b-a1f59383c774 req-dd3dfd8d-669c-4827-8528-612ecb7afb02 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:16.476915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-b593baba-57e1-451e-874b-a1f59383c774 req-dd3dfd8d-669c-4827-8528-612ecb7afb02 service nova] Creating event network-vif-deleted:1d0bca79-ab73-4643-a78f-e91fb3ea863b for instance f9d640ec-d458-44c1-954e-3f1b66a0f79c on hv-cinder-83979 May 31 18:36:16.485546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-b593baba-57e1-451e-874b-a1f59383c774 req-dd3dfd8d-669c-4827-8528-612ecb7afb02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044741 May 31 18:36:16.486156 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 470/951] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:36:17.421722 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:17.422354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:17.428878 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:17.429333 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:17.430108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:17.430556 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:17.496339 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:17.503995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-932c1899-fea1-49f3-9834-c851e6da3284 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1220 microversion: 2.1 time: 0.087425 May 31 18:36:17.504575 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 482/952] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:17 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:18.522506 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:18.523241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:18.525682 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:36:18.532547 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:18.532994 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:18.533752 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:18.534186 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:18.595852 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:18.603237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7b7f9312-be87-46ff-9e05-ef84f194b32b tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1220 microversion: 2.1 time: 0.085419 May 31 18:36:18.603800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 471/953] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:18 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:19.620051 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:19.621049 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:19.627120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:19.627569 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:19.628381 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:19.628820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:19.692963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:19.700394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7c2fbfa6-90ec-47ac-b237-6bff0aad45c3 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1220 microversion: 2.1 time: 0.084227 May 31 18:36:19.700954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 483/954] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:19 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1220 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:20.717134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:20.717779 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:20.724338 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:20.724794 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:20.725679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:20.725986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:20.787957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:20.796111 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-069c995d-6d9f-4f9f-8ca8-32d2f07868df tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1220 microversion: 2.1 time: 0.082957 May 31 18:36:20.797035 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 472/955] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:20 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1220 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:21.814938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:21.815869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:21.818687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:36:21.824481 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:21.824926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:21.825690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:21.826135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:21.887963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '033cd9363e244fd981665ff6611f5e00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e7d985181c9439cbc10711bb34c0431', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:21.895457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7b6c564a-4235-42d0-a09a-d8e3cd7116fa tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 200 len: 1220 microversion: 2.1 time: 0.085694 May 31 18:36:21.896020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 484/956] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:21 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:36:22.913384 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:22.914148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] [instance: f9d640ec-d458-44c1-954e-3f1b66a0f79c] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:22.921637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:22.922083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:22.922916 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:22.923353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:22.937558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] HTTP exception thrown: Instance f9d640ec-d458-44c1-954e-3f1b66a0f79c could not be found. May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Request method failure captured: May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c HTTP/1.1 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill7B7u3RDzuKzPxcbRF8wVBxJzBt2E5zVIHdHlKcFRwPhhgXu4p0RxMMBz6gWm4rDe-qgAuRTMAj1mipvk4PPlZeTDP9aEsyn4bA5QC1V_EBwKIfOn5VzLPcVpMxcfUH-gdq-iER11U1MnfxhKr5B8T2G7vgkPbKgYJyzb6yzgPfZ54 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 1e7d985181c9439cbc10711bb34c0431 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-TestShelveInstance-66715469 May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:36:22.939185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e7d985181c9439cbc10711bb34c0431"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_1e7d985181c9439cbc10711bb34c0431"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/1e7d985181c9439cbc10711bb34c0431"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/1e7d985181c9439cbc10711bb34c0431"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-TestShelveInstance-66715469 May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 1e7d985181c9439cbc10711bb34c0431 May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-TestShelveInstance-66715469 May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-TestShelveInstance-66715469-project May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: 033cd9363e244fd981665ff6611f5e00 May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-TestShelveInstance-66715469-project May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance f9d640ec-d458-44c1-954e-3f1b66a0f79c could not be found. May 31 18:36:22.940817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'f9d640ec-d458-44c1-954e-3f1b66a0f79c'} May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d640ec-d458-44c1-954e-3f1b66a0f79c could not be found. May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:36:22.941703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d640ec-d458-44c1-954e-3f1b66a0f79c could not be found. May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d640ec-d458-44c1-954e-3f1b66a0f79c could not be found. May 31 18:36:22.943151 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:36:22.944325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Returning 404 to user: Instance f9d640ec-d458-44c1-954e-3f1b66a0f79c could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:36:22.944325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7ce1ae97-b674-4b87-a75d-0f37439b2fb9 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c" status: 404 len: 111 microversion: 2.1 time: 0.031353 May 31 18:36:22.944325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 473/957] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:22 2022] GET /compute/v2.1/servers/f9d640ec-d458-44c1-954e-3f1b66a0f79c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:36:23.112903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7b6aa60c-15b7-45e5-9577-8adf3d8c2755 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] Calling method '.version_select at 0x7ffb75642790>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:23.131946 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7b6aa60c-15b7-45e5-9577-8adf3d8c2755 tempest-TestShelveInstance-66715469 tempest-TestShelveInstance-66715469-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1396923003" status: 202 len: 0 microversion: 2.1 time: 0.022808 May 31 18:36:23.132853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 485/958] 10.222.0.17 () {58 vars in 1253 bytes} [Tue May 31 18:36:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1396923003 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:36:34.138017 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:36:34.138715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:36:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:36:58.819926 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-388954293", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:36:58.826333 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=5 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:36:58.826974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=49 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:36:58.878837 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] validate_networks() for None {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:36:59.147125 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:36:59.147570 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:36:59.148035 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:36:59.148465 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:36:59.148872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:36:59.157929 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:59.158367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:59.159150 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:36:59.159580 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:36:59.179117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Getting quotas for project f33630b56f8c4fe182b74165961a94f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:36:59.182968 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Getting quotas for user 021461a009e64e58910d9f37cb58a076 and project f33630b56f8c4fe182b74165961a94f5. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:36:59.194442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:36:59.196705 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:36:59.240821 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bd0171ad-df98-4dd6-852c-1844c2c85e82 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.424605 May 31 18:36:59.241375 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 474/959] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 18:36:59.249934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:36:59.250692 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:36:59.256851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ac048dbf-f7ad-499a-aeed-18ec86b0574b tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:36:59.257497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ac048dbf-f7ad-499a-aeed-18ec86b0574b tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:36:59.318811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ac048dbf-f7ad-499a-aeed-18ec86b0574b tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:36:59.326104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ac048dbf-f7ad-499a-aeed-18ec86b0574b tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1214 microversion: 2.1 time: 0.077851 May 31 18:36:59.326668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 486/960] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:36:59 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:00.344315 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:00.344978 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:00.351359 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:00.351812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:00.352611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:00.353241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:00.451704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:00.459427 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a4dbbfb3-0e2b-4335-a8e2-e718b209daba tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1274 microversion: 2.1 time: 0.120481 May 31 18:37:00.459997 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 475/961] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:00 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1274 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:01.476484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:01.477114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:01.483926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:01.484411 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:01.485193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:01.485639 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:01.719235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:01.728416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4d932149-75e9-4f87-8386-a58954e8cb1e tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.255355 May 31 18:37:01.729258 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 487/962] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:01 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:01.929042 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-9c6a2360-2e75-44b3-a801-2ddf2352ea9e req-73107769-7df0-4a65-ba55-50031009710b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3ef64aa-2046-416a-9302-c1cd2b760e80", "tag": "6586437f-9a27-4c02-8a34-23e3040c26a4"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:01.939230 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9c6a2360-2e75-44b3-a801-2ddf2352ea9e req-73107769-7df0-4a65-ba55-50031009710b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:01.939674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9c6a2360-2e75-44b3-a801-2ddf2352ea9e req-73107769-7df0-4a65-ba55-50031009710b service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:01.955768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-9c6a2360-2e75-44b3-a801-2ddf2352ea9e req-73107769-7df0-4a65-ba55-50031009710b service nova] Creating event network-changed:6586437f-9a27-4c02-8a34-23e3040c26a4 for instance a3ef64aa-2046-416a-9302-c1cd2b760e80 on hv-cinder-83979 May 31 18:37:01.960703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-9c6a2360-2e75-44b3-a801-2ddf2352ea9e req-73107769-7df0-4a65-ba55-50031009710b service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042171 May 31 18:37:01.961611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 476/963] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:37:02.746003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:02.747289 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:02.754453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:02.754897 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:02.755666 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:02.756114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:02.891572 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:02.899009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-98438fb4-a7cb-410f-9885-dd54cc17254f tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.157005 May 31 18:37:02.899567 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 488/964] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:02 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:03.917567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:03.918265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:03.924656 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:03.925101 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:03.925860 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:03.926295 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:04.058498 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:04.066562 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1a598210-54cf-48ad-9719-fb9820141e4a tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.153655 May 31 18:37:04.067127 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 477/965] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:03 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:05.083799 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:05.084849 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:05.092427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.092855 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.093641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.094076 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.405150 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:05.405744 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:05.412262 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.412786 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.413649 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.414158 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.443003 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0ca0e3d5-738f-4d02-a1db-d383ee44dcca tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments/e07c077c-8096-4132-966f-70cd3ab67046" status: 200 len: 194 microversion: 2.20 time: 0.042831 May 31 18:37:05.443599 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 478/966] 10.222.0.17 () {60 vars in 1453 bytes} [Tue May 31 18:37:05 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments/e07c077c-8096-4132-966f-70cd3ab67046 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 18:37:05.499873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:05.507848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-763ebf10-03fe-43be-b272-dd4a23508209 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.428802 May 31 18:37:05.508027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:05.508439 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 489/967] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:05 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:05.508578 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:05.515544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.516082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.517107 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.517616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.604318 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lazy-loading 'services' on Instance uuid d4134a34-2a85-4a0b-96fd-f221227ee2c4 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:37:05.683571 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-643ada56-4b70-4e3e-ac72-2df7193bbc42 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments/e07c077c-8096-4132-966f-70cd3ab67046" status: 202 len: 0 microversion: 2.20 time: 0.179255 May 31 18:37:05.685214 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 479/968] 10.222.0.17 () {60 vars in 1456 bytes} [Tue May 31 18:37:05 2022] DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments/e07c077c-8096-4132-966f-70cd3ab67046 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 31 18:37:05.693566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:05.694669 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:05.702775 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.703398 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.704657 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:05.705477 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:05.738356 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cc7f268e-ada8-46a0-974a-b5e304924288 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048898 May 31 18:37:05.739717 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 490/969] 10.222.0.17 () {60 vars in 1342 bytes} [Tue May 31 18:37:05 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:37:06.527272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:06.528039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:06.534699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.535139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.535884 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.536355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.677355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:06.685369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-14f86447-560e-4f07-aebd-812e5f85a0ab tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.162192 May 31 18:37:06.685964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 480/970] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:06 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:06.750366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:06.751384 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:06.758234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.758653 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.759442 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.759859 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.789632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cf58b9e5-1834-4d79-a172-1eca478c35f2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043611 May 31 18:37:06.790172 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 491/971] 10.222.0.17 () {60 vars in 1342 bytes} [Tue May 31 18:37:06 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:06.846971 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:06.847468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:06.853488 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.853935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.854698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.855129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.883115 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:37:06.961855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c56e5fb5-e6f4-4258-a3ae-504741210fd2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 204 len: 0 microversion: 2.20 time: 0.118286 May 31 18:37:06.962457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 481/972] 10.222.0.17 () {60 vars in 1279 bytes} [Tue May 31 18:37:06 2022] DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 18:37:06.972253 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:06.974881 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:06.980553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.980553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:06.982185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:06.982763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:07.131066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:07.140482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:07.142106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:07.143322 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-61f3233f-1a27-45f2-a3ec-5de7d522ecff tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.175309 May 31 18:37:07.143874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 492/973] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:06 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:07.256001 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-da4299df-5748-4b70-a40e-d6a498599d52 req-fff85d9f-9676-47d7-ac57-3770e7f6da7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ef64aa-2046-416a-9302-c1cd2b760e80", "name": "network-vif-plugged", "status": "completed", "tag": "6586437f-9a27-4c02-8a34-23e3040c26a4"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:07.265183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-da4299df-5748-4b70-a40e-d6a498599d52 req-fff85d9f-9676-47d7-ac57-3770e7f6da7c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:07.265620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-da4299df-5748-4b70-a40e-d6a498599d52 req-fff85d9f-9676-47d7-ac57-3770e7f6da7c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:07.276397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-da4299df-5748-4b70-a40e-d6a498599d52 req-fff85d9f-9676-47d7-ac57-3770e7f6da7c service nova] Creating event network-vif-plugged:6586437f-9a27-4c02-8a34-23e3040c26a4 for instance a3ef64aa-2046-416a-9302-c1cd2b760e80 on hv-cinder-83979 May 31 18:37:07.282039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-da4299df-5748-4b70-a40e-d6a498599d52 req-fff85d9f-9676-47d7-ac57-3770e7f6da7c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158910 May 31 18:37:07.282603 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 482/974] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:37:07.702361 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:07.703007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:07.709082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:07.709530 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:07.710293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:07.710731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:07.840018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:07.848143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ff5dea84-cbae-4e04-bd44-14d6a019c930 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.149660 May 31 18:37:07.848694 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 493/975] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:07 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:08.164286 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:08.164972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:08.171519 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:08.171964 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:08.172752 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:08.173183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:08.306244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:08.315049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:08.316586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:08.317763 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-f8b0aa5c-61b0-4fd7-834b-34db48e35c1f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.158177 May 31 18:37:08.318306 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 483/976] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:08 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:08.865045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:08.865661 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:08.873373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:08.873845 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:08.874629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:08.875062 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:09.011318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:09.020780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c1e63ebf-6733-4b2c-8cac-afba71201edc tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1314 microversion: 2.1 time: 0.159556 May 31 18:37:09.021346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 494/977] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:08 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:09.336609 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:09.337218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:09.339587 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:09.341044 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:09.346694 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:09.347137 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:09.347893 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:09.348353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:09.480049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:09.487988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:09.489526 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:09.490680 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ae28666b-9175-41cf-8b10-abf1e98c9fa4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1723 microversion: 2.20 time: 0.158010 May 31 18:37:09.491243 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 484/978] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:09 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:10.038207 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:10.038830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:10.041927 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:10.046548 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.047035 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.047955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.048281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.240866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:10.248636 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5a293163-8247-4063-9168-143df9d31dbf tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1464 microversion: 2.1 time: 0.214315 May 31 18:37:10.249204 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 495/979] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:10 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1464 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:10.289461 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:10.290011 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:10.296081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.296566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.297518 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.297954 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.323379 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:37:10.410342 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-1d0848ca-786d-4b31-813b-6a84dde435ee req-3e85f1ea-ebaa-4f7a-8dc0-d91a4f807cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4134a34-2a85-4a0b-96fd-f221227ee2c4", "name": "network-vif-deleted", "tag": "ae1f3574-a91c-4ffe-b052-7bb97ab87437"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:10.419804 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1d0848ca-786d-4b31-813b-6a84dde435ee req-3e85f1ea-ebaa-4f7a-8dc0-d91a4f807cea service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.420644 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1d0848ca-786d-4b31-813b-6a84dde435ee req-3e85f1ea-ebaa-4f7a-8dc0-d91a4f807cea service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.432842 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-1d0848ca-786d-4b31-813b-6a84dde435ee req-3e85f1ea-ebaa-4f7a-8dc0-d91a4f807cea service nova] Creating event network-vif-deleted:ae1f3574-a91c-4ffe-b052-7bb97ab87437 for instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 on hv-cinder-83979 May 31 18:37:10.439355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-1d0848ca-786d-4b31-813b-6a84dde435ee req-3e85f1ea-ebaa-4f7a-8dc0-d91a4f807cea service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032566 May 31 18:37:10.440561 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 496/980] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:37:10.462838 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bcf363f3-8f41-4e35-8519-3a34fca8c6d4 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "DELETE /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 204 len: 0 microversion: 2.1 time: 0.177150 May 31 18:37:10.463411 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 485/981] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:37:10 2022] DELETE /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:37:10.473832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:10.474649 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:10.483454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.483996 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.485107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.485725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.510855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:10.511568 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:10.520516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.521339 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.522380 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:10.523097 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:10.614040 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:10.622546 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:10.624191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:10.625335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2136d40e-2da3-4011-9ae3-7edb53a25352 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1367 microversion: 2.20 time: 0.119781 May 31 18:37:10.626141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 486/982] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:10 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1367 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:10.677270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:10.685705 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2ece6f09-3ce5-4cb7-a15a-3884ed1e25d8 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1470 microversion: 2.1 time: 0.217143 May 31 18:37:10.686273 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 497/983] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:10 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1470 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:11.644196 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:11.644734 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:11.651025 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:11.651477 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:11.652312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:11.653492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:11.693075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:11.693521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:11.693974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lazy-loading 'fault' on Instance uuid d4134a34-2a85-4a0b-96fd-f221227ee2c4 {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:37:11.703998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:11.703998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:11.711623 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:11.712078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:11.712884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:11.713318 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:11.739511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:11.747595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:11.749160 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:11.750318 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1e66e811-a2a4-468e-b62c-0bb12efcbdea tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 200 len: 1372 microversion: 2.20 time: 0.110168 May 31 18:37:11.750869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 487/984] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:11 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:37:11.844283 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:11.851866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6d4bcf37-6bf5-45fe-abd1-e06605e4d0e6 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1470 microversion: 2.1 time: 0.152898 May 31 18:37:11.852772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 498/985] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:11 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1470 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:37:12.634977 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-adaa447e-8e70-4898-897f-df6e4e37c8a4 req-422eb0d8-edb6-401d-8c74-e6e297387ecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3ef64aa-2046-416a-9302-c1cd2b760e80", "name": "network-vif-deleted", "tag": "6586437f-9a27-4c02-8a34-23e3040c26a4"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:12.645935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-adaa447e-8e70-4898-897f-df6e4e37c8a4 req-422eb0d8-edb6-401d-8c74-e6e297387ecd service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:12.646652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-adaa447e-8e70-4898-897f-df6e4e37c8a4 req-422eb0d8-edb6-401d-8c74-e6e297387ecd service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:12.651325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:12.660804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-adaa447e-8e70-4898-897f-df6e4e37c8a4 req-422eb0d8-edb6-401d-8c74-e6e297387ecd service nova] Creating event network-vif-deleted:6586437f-9a27-4c02-8a34-23e3040c26a4 for instance a3ef64aa-2046-416a-9302-c1cd2b760e80 on hv-cinder-83979 May 31 18:37:12.667486 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-adaa447e-8e70-4898-897f-df6e4e37c8a4 req-422eb0d8-edb6-401d-8c74-e6e297387ecd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036979 May 31 18:37:12.668114 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 488/986] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:37:12.769103 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:12.769729 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:12.776136 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:12.776612 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:12.777400 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:12.778368 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:12.792772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] HTTP exception thrown: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Request method failure captured: May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 HTTP/1.1 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill9kQCepYN5928b5nUo59-e5Sa-wfo6WdS0QOvRl5r4UGiPZcY88L0Ion4cc8MM1G-SyrfJLRDplDBG4A879CB0IqoqpC6OOleckbb0JcUPTY2fymy5BFb-DXJSQ-XXyjNWPJMSSRZz-s0dbgSV_yaMMRchQyL28sKL_1aI6ekQyvNk May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Openstack-Nova-Api-Version: 2.20 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:37:12.795156 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: eae1472e93fd44d5a621e03f2f2e8476 May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:37:12.796920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'd4134a34-2a85-4a0b-96fd-f221227ee2c4'} May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:37:12.798576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:37:12.799926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:12.801650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Returning 404 to user: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:37:12.801650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b1767513-096b-482f-a27a-2ab9871af59f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 404 len: 111 microversion: 2.20 time: 0.031678 May 31 18:37:12.801650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 499/987] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:12 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 18:37:12.806054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6977927b-4d9f-4e3f-8cd3-eb4867406ece tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '.version_select at 0x7ffb74258280>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:12.823311 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6977927b-4d9f-4e3f-8cd3-eb4867406ece tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860443877" status: 204 len: 0 microversion: 2.20 time: 0.021407 May 31 18:37:12.824106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 489/988] 10.222.0.17 () {60 vars in 1261 bytes} [Tue May 31 18:37:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1860443877 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 18:37:12.870028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:12.870633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:12.876568 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:12.877018 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:12.877795 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:12.878226 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:12.909909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:12.910357 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:12.910808 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lazy-loading 'fault' on Instance uuid a3ef64aa-2046-416a-9302-c1cd2b760e80 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:37:12.967005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '021461a009e64e58910d9f37cb58a076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f33630b56f8c4fe182b74165961a94f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:12.974311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-54cec0b5-6d4a-4e7e-a86b-18b8cc118f62 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 200 len: 1304 microversion: 2.1 time: 0.108639 May 31 18:37:12.974994 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 500/989] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:12 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:13.509912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4ecb1294-04f6-465f-b7b1-84f13d6d7781 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'create', calling method: .version_select at 0x7ffb6efec790>, body: {"keypair": {"name": "tempest-keypair-91458027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZBrgsusbkc7Cx3W05vupcAGy/hnk9j3jDYTzmENfr7/CUzmxGSjmk+qlNcwq8THRgPFbPdB0UVe2XGz1aOvzXrU/NYEmvOz/F6qydAQG+l57/ftFdj4EmCmdJiv+ABgg=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:13.523693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4ecb1294-04f6-465f-b7b1-84f13d6d7781 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:37:13.527412 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4ecb1294-04f6-465f-b7b1-84f13d6d7781 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for user eae1472e93fd44d5a621e03f2f2e8476 and project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:37:13.549463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4ecb1294-04f6-465f-b7b1-84f13d6d7781 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.044654 May 31 18:37:13.550037 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 490/990] 10.222.0.17 () {62 vars in 1199 bytes} [Tue May 31 18:37:13 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 46 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 31 18:37:13.991079 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:13.992150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] [instance: a3ef64aa-2046-416a-9302-c1cd2b760e80] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:13.998948 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:13.999394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:14.000203 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:14.000815 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:14.015013 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] HTTP exception thrown: Instance a3ef64aa-2046-416a-9302-c1cd2b760e80 could not be found. May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Request method failure captured: May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 HTTP/1.1 May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmBJMXnzSHmCbhTHWpq_CyGJwjNFIuHAEFXP_TOfWoevuAA3asoMVQDCg13-YZ0heL84HYl2AZSooxEAXlJKlJf3z_Tg7piDXEsTRI_OG8cAhmZousaX0xtcE4_BFJjISY8WQa_wUwm2mjwLhVRuep5sfgiu_9XxsL0g71aRC5pkKLw May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: f33630b56f8c4fe182b74165961a94f5 May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-VolumesNegativeTest-138992817 May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:37:14.016583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f33630b56f8c4fe182b74165961a94f5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_f33630b56f8c4fe182b74165961a94f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/f33630b56f8c4fe182b74165961a94f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/f33630b56f8c4fe182b74165961a94f5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-VolumesNegativeTest-138992817 May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: f33630b56f8c4fe182b74165961a94f5 May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-VolumesNegativeTest-138992817 May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-VolumesNegativeTest-138992817-project May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 021461a009e64e58910d9f37cb58a076 May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-VolumesNegativeTest-138992817-project May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance a3ef64aa-2046-416a-9302-c1cd2b760e80 could not be found. May 31 18:37:14.018137 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'a3ef64aa-2046-416a-9302-c1cd2b760e80'} May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3ef64aa-2046-416a-9302-c1cd2b760e80 could not be found. May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:37:14.021601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3ef64aa-2046-416a-9302-c1cd2b760e80 could not be found. May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3ef64aa-2046-416a-9302-c1cd2b760e80 could not be found. May 31 18:37:14.023036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:37:14.024314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] Returning 404 to user: Instance a3ef64aa-2046-416a-9302-c1cd2b760e80 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:37:14.024314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5737991e-2748-4173-ab52-3da473906073 tempest-VolumesNegativeTest-138992817 tempest-VolumesNegativeTest-138992817-project] 10.222.0.17 "GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80" status: 404 len: 111 microversion: 2.1 time: 0.030808 May 31 18:37:14.024314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 501/991] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:13 2022] GET /compute/v2.1/servers/a3ef64aa-2046-416a-9302-c1cd2b760e80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:37:14.874232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1301467276", "imageRef": "d60cd27f-4caa-4f72-b17a-87775f5e2474", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "575d4a63-fb04-4ed5-a3bf-841d4712605f"}], "security_groups": [{"name": "tempest-securitygroup--922142616"}], "key_name": "tempest-keypair-91458027", "user_data": "}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:14.979487 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] validate_networks() for [('575d4a63-fb04-4ed5-a3bf-841d4712605f', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:37:15.372377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:37:15.372377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:37:15.372377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:37:15.372812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:37:15.373224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:37:15.382206 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:15.382648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:15.383423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:15.383848 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:15.401909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:37:15.407029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Getting quotas for user eae1472e93fd44d5a621e03f2f2e8476 and project 08edb56fe0174a94b32148eb8c6291d3. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:37:15.417688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:37:15.420222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d60cd27f-4caa-4f72-b17a-87775f5e2474',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:37:15.468081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e13e97bc-28c5-4074-81b0-6213cc8e7a6a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.599200 May 31 18:37:15.468752 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 491/992] 10.222.0.17 () {62 vars in 1187 bytes} [Tue May 31 18:37:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 18:37:15.479126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-16afba5c-ab2e-4ee8-8336-01b3181e60ce tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:15.479810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-16afba5c-ab2e-4ee8-8336-01b3181e60ce tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:15.545311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-16afba5c-ab2e-4ee8-8336-01b3181e60ce tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:15.553055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-16afba5c-ab2e-4ee8-8336-01b3181e60ce tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:15.554597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-16afba5c-ab2e-4ee8-8336-01b3181e60ce tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:15.555703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-16afba5c-ab2e-4ee8-8336-01b3181e60ce tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1280 microversion: 2.20 time: 0.080782 May 31 18:37:15.556487 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 502/993] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:15 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1280 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:16.574235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:16.577585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:16.586475 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:16.587300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:16.588351 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:16.588930 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:16.670051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:16.678059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:16.679626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:16.680769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-408d154a-8533-4b19-a2c9-d1154b344a59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1338 microversion: 2.20 time: 0.110881 May 31 18:37:16.681540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 492/994] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:16 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:17.700794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:17.701408 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:17.708968 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:17.709660 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:17.710846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:17.711388 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:17.930331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:17.939757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:17.941463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:17.942629 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-fb644d65-c7f0-4c46-b00b-9f84af16ea69 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1405 microversion: 2.20 time: 0.246563 May 31 18:37:17.943183 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 503/995] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:17 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:18.075705 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-93512187-a4fa-4488-b52f-299b5430a4d7 req-478a0529-8fc8-4b22-8af6-f960ce38a5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:18.086825 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-93512187-a4fa-4488-b52f-299b5430a4d7 req-478a0529-8fc8-4b22-8af6-f960ce38a5fc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:18.087620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-93512187-a4fa-4488-b52f-299b5430a4d7 req-478a0529-8fc8-4b22-8af6-f960ce38a5fc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:18.106443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-93512187-a4fa-4488-b52f-299b5430a4d7 req-478a0529-8fc8-4b22-8af6-f960ce38a5fc service nova] Creating event network-changed:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:37:18.119099 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-93512187-a4fa-4488-b52f-299b5430a4d7 req-478a0529-8fc8-4b22-8af6-f960ce38a5fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047135 May 31 18:37:18.120120 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 493/996] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:37:18.963081 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:18.963713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:18.970602 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:18.971250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:18.972028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:18.972494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:19.107674 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:19.115668 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:19.117206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:19.118323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2748a589-a244-4532-b1ce-1245e6c9ff59 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1405 microversion: 2.20 time: 0.159122 May 31 18:37:19.118870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 504/997] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:18 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:20.139239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:20.140119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:20.147186 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:20.147690 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:20.148481 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:20.149077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:20.689879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:20.703462 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:20.705521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:20.706912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-162068d3-2d76-412f-84ea-f7dd64194dd4 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1405 microversion: 2.20 time: 0.573159 May 31 18:37:20.707637 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 494/998] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:20 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1405 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:21.725354 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:21.726597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:21.734453 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:21.735224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:21.736259 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:21.737499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:21.994155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:22.006596 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:22.008416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:22.009547 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7c4116f4-1372-468c-b2c1-076f11f2192f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1405 microversion: 2.20 time: 0.288069 May 31 18:37:22.020593 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 505/999] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:21 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1405 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:23.039425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:23.040708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:23.045122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:23.059606 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:23.060585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:23.061293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:23.061658 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:23.347014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:23.356351 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:23.358685 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:23.364393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7d7b02d3-d1d2-41eb-8629-dc49715b402d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1405 microversion: 2.20 time: 0.329563 May 31 18:37:23.365648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 495/1000] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:23 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1405 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:23.381983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-bbb5b370-3b6d-4b21-97e2-fcd4e54fc926 req-8e00d1a7-9c38-424b-9aae-1b426c4116b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "name": "network-vif-plugged", "status": "completed", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:23.394431 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-bbb5b370-3b6d-4b21-97e2-fcd4e54fc926 req-8e00d1a7-9c38-424b-9aae-1b426c4116b4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:23.394880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-bbb5b370-3b6d-4b21-97e2-fcd4e54fc926 req-8e00d1a7-9c38-424b-9aae-1b426c4116b4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:23.406028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=100 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:23.409287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-bbb5b370-3b6d-4b21-97e2-fcd4e54fc926 req-8e00d1a7-9c38-424b-9aae-1b426c4116b4 service nova] Creating event network-vif-plugged:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:37:23.418278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-bbb5b370-3b6d-4b21-97e2-fcd4e54fc926 req-8e00d1a7-9c38-424b-9aae-1b426c4116b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040088 May 31 18:37:23.419559 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 506/1001] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:37:24.383224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:24.383885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:24.391772 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:24.392362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:24.393474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:24.393982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:24.546167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:24.555998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:24.557840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:24.559259 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-115bbc3f-56c5-469b-a9cc-17a195cbe844 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1405 microversion: 2.20 time: 0.180144 May 31 18:37:24.559821 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 496/1002] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:24 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:25.583253 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:25.584725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:25.593640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:25.597946 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:25.598746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:25.600302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:25.600999 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:25.854267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:25.874313 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:25.875882 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:25.877293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2ef0a7e6-58af-4c8e-a59f-7d02f7fc6475 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1597 microversion: 2.20 time: 0.302836 May 31 18:37:25.877846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 507/1003] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:37:25 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1597 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:37:25.898962 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:25.900129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:25.904875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:25.908290 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=10 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:25.912759 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:25.913507 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:25.914533 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:25.915239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:26.335315 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-36939370-84f9-4779-afc6-f458ae36f727 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.442990 May 31 18:37:26.336387 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 497/1004] 10.222.0.17 () {60 vars in 1315 bytes} [Tue May 31 18:37:25 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-interface => generated 285 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:37:28.153303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-37dd00a1-520a-4e22-985b-d4b122261964 req-ac583f40-c827-4a6f-871e-dd3846428630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:28.175725 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-37dd00a1-520a-4e22-985b-d4b122261964 req-ac583f40-c827-4a6f-871e-dd3846428630 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:28.176352 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-37dd00a1-520a-4e22-985b-d4b122261964 req-ac583f40-c827-4a6f-871e-dd3846428630 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:28.193748 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-37dd00a1-520a-4e22-985b-d4b122261964 req-ac583f40-c827-4a6f-871e-dd3846428630 service nova] Creating event network-changed:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:37:28.208033 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-37dd00a1-520a-4e22-985b-d4b122261964 req-ac583f40-c827-4a6f-871e-dd3846428630 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389565 May 31 18:37:28.208680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 508/1005] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:37:30.386408 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7c802250-e17d-43a7-a7c2-8a29a952ecc5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Action: 'create', calling method: .version_select at 0x7ffb74d701f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1714846868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8TcDFgkS70AiPuF6wxtJZ5QIqq7+azQsjN6yXoE9Olk/Rr0zsr3ifdkVamKOGHVkTuIngrYl34RC4ZthiSdUA0ZqBl5NGGjL2UioWuwTf9M+t4NQ/JqgOoEUZGz5e4uQ=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:30.399999 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-7c802250-e17d-43a7-a7c2-8a29a952ecc5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:37:30.403813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-7c802250-e17d-43a7-a7c2-8a29a952ecc5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for user ebcdfe9038fe4e0580a4fe79ae13e520 and project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:37:30.425673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7c802250-e17d-43a7-a7c2-8a29a952ecc5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.148989 May 31 18:37:30.426261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 498/1006] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:37:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:37:52.933540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=52 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:52.934276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=8 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:52.938379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-402116150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1714846868", "security_groups": [{"name": "tempest-secgroup-smoke-1499054043"}], "block_device_mapping_v2": [{"uuid": "f36fb93f-c89e-4a2e-a84d-fc98aad5bd7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1aa4c12e-adcc-4d8a-a0f1-1185914da5b1"}]}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:53.049323 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] validate_networks() for [('1aa4c12e-adcc-4d8a-a0f1-1185914da5b1', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:37:53.554880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:37:53.555340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:37:53.555841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:37:53.556293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:37:53.556709 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:37:53.566468 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:53.566909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:53.567724 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:53.568182 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:53.584567 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:37:53.588408 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for user ebcdfe9038fe4e0580a4fe79ae13e520 and project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:37:53.645342 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:37:53.647494 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f36fb93f-c89e-4a2e-a84d-fc98aad5bd7a',volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:37:53.774438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-10759ed6-04bc-424f-904a-5f402fc35650 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.842387 May 31 18:37:53.775068 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 509/1007] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:37:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:37:53.782342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=32 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:53.783169 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:53.783858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:37:53.788532 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2f2fa082-28b2-460a-a29c-9f929b11e501 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:53.790238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2f2fa082-28b2-460a-a29c-9f929b11e501 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:53.847892 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2f2fa082-28b2-460a-a29c-9f929b11e501 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:53.855827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2f2fa082-28b2-460a-a29c-9f929b11e501 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1094 microversion: 2.1 time: 0.074739 May 31 18:37:53.856407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 499/1008] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:53 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:54.873454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:54.874818 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:54.881941 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:54.882854 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:54.883640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:54.884067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:54.965219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:54.973670 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-344ee0b8-9673-4c91-95b6-9cc49fb0c72a tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1210 microversion: 2.1 time: 0.104230 May 31 18:37:54.974455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 510/1009] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:54 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:55.990658 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:55.991280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:55.997909 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:55.998362 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:55.999182 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:56.000009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:56.201790 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:56.209906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e6983652-1ffb-45c7-a562-3b86560195f9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.223125 May 31 18:37:56.210480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 500/1010] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:55 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:56.314953 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-eeb439c5-9e54-4da1-9f4e-057933d12ca9 req-6883bbaf-97c6-45bc-8c8b-a9c7646407fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6528eeaf-9d4b-4360-8a1a-1f2b78983f95", "tag": "95bc34e8-51d2-4a24-bf33-2dc41269f593"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:37:56.323367 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-eeb439c5-9e54-4da1-9f4e-057933d12ca9 req-6883bbaf-97c6-45bc-8c8b-a9c7646407fc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:56.323823 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-eeb439c5-9e54-4da1-9f4e-057933d12ca9 req-6883bbaf-97c6-45bc-8c8b-a9c7646407fc service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:56.339532 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-eeb439c5-9e54-4da1-9f4e-057933d12ca9 req-6883bbaf-97c6-45bc-8c8b-a9c7646407fc service nova] Creating event network-changed:95bc34e8-51d2-4a24-bf33-2dc41269f593 for instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 on hv-cinder-83979 May 31 18:37:56.345706 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-eeb439c5-9e54-4da1-9f4e-057933d12ca9 req-6883bbaf-97c6-45bc-8c8b-a9c7646407fc service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035177 May 31 18:37:56.346712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 511/1011] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:37:57.226802 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:57.227442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:57.234059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:57.234511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:57.235253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:57.235679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:57.379889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:57.387432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4a89a135-f2ee-493a-a5d6-f3e1279184d1 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.164533 May 31 18:37:57.387984 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 501/1012] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:57 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:58.405455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:58.406171 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:58.412525 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:58.412918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:58.413698 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:58.414217 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:58.553705 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:58.561228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8e6016e4-5587-4cef-89ca-a046b2283e8c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.161067 May 31 18:37:58.562020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 512/1013] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:58 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:37:59.578513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:37:59.579118 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:37:59.585566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:59.586006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:59.586762 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:37:59.587186 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:37:59.714489 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:37:59.721954 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-dbad719a-dc4f-433b-a124-352cf5504631 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.147459 May 31 18:37:59.722511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 502/1014] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:37:59 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:00.739122 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:00.739761 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:00.746298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:00.746738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:00.747489 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:00.747918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:00.877969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:00.885619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a3d55e5f-42b0-4c75-a9ae-0ca6d3d73bbc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.150348 May 31 18:38:00.886163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 513/1015] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:00 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:01.902593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:01.903207 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:01.909868 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:01.910318 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:01.911080 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:01.911519 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:02.040896 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:02.048880 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e10e8724-6e98-4fa0-8170-a38fb6ad4ba9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.150119 May 31 18:38:02.049461 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 503/1016] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:01 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:03.066224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:03.066836 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:03.073476 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:03.073920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:03.074677 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:03.075108 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:03.210960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:03.218812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-971368bd-2e63-41e9-bbfb-f3eadcc2c401 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.157264 May 31 18:38:03.219369 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 514/1017] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:03 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:04.235105 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:04.235724 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:04.238056 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:04.243350 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:04.243795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:04.244703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:04.245177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:04.388608 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:04.396549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-20e10049-435b-4540-8a18-e8c8eeb72bac tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.165530 May 31 18:38:04.397120 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 504/1018] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:04 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:05.413281 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:05.413824 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:05.415721 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:05.416535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=6 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:05.422857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:05.423590 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:05.424578 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:05.425007 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:05.566406 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:05.573722 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6c2c9684-4b3b-48e9-8e6c-802fda950ae3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.164374 May 31 18:38:05.574282 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 515/1019] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:05 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:06.593224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:06.594549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:06.600991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:06.601441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:06.602197 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:06.602631 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:06.733540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:06.741126 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c69a01ae-bf20-47d8-a4e6-187ab54eb5cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.151846 May 31 18:38:06.741675 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 505/1020] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:06 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:07.373019 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-67cf72f3-2bd3-410f-8f9a-e64093ae317b req-fb2753c4-84ee-472f-8669-90152cce10bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528eeaf-9d4b-4360-8a1a-1f2b78983f95", "name": "network-vif-plugged", "status": "completed", "tag": "95bc34e8-51d2-4a24-bf33-2dc41269f593"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:38:07.383746 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-67cf72f3-2bd3-410f-8f9a-e64093ae317b req-fb2753c4-84ee-472f-8669-90152cce10bd service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:07.384270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-67cf72f3-2bd3-410f-8f9a-e64093ae317b req-fb2753c4-84ee-472f-8669-90152cce10bd service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:07.395688 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-67cf72f3-2bd3-410f-8f9a-e64093ae317b req-fb2753c4-84ee-472f-8669-90152cce10bd service nova] Creating event network-vif-plugged:95bc34e8-51d2-4a24-bf33-2dc41269f593 for instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 on hv-cinder-83979 May 31 18:38:07.400502 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-67cf72f3-2bd3-410f-8f9a-e64093ae317b req-fb2753c4-84ee-472f-8669-90152cce10bd service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031157 May 31 18:38:07.401086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 516/1021] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:38:07.758934 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:07.759547 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:07.766103 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:07.766544 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:07.767295 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:07.767723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:07.909325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:07.917876 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-700adfbc-f1cb-4faf-b2f4-e0f6ab13e63f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.163236 May 31 18:38:07.918458 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 506/1022] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:07 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:08.942093 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:08.942785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:08.948931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:08.949383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:08.950139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:08.950580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:09.086982 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:09.094832 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e3a2a646-e77a-4998-8279-c0d5070ab182 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1266 microversion: 2.1 time: 0.158297 May 31 18:38:09.095397 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 517/1023] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:08 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:10.111613 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:10.112357 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:10.118783 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:10.119234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:10.119997 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:10.120458 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:10.254019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:10.261780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-87b0ca59-5356-4f8f-bae9-e9b7355fb9f3 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1453 microversion: 2.1 time: 0.154250 May 31 18:38:10.262376 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 507/1024] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:10 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:10.278162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:10.278834 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:10.285338 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:10.285788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:10.286555 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:10.286994 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:10.416677 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:10.424728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-3035a864-e1ad-4374-b34b-b06ec78fb1dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1453 microversion: 2.1 time: 0.150414 May 31 18:38:10.425293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 518/1025] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:38:10 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:38:12.339357 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-5fba4f09-5da4-4922-9b50-8009d474b0fa req-868d504e-3eea-4c3a-8e12-d58162f3be02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6528eeaf-9d4b-4360-8a1a-1f2b78983f95", "tag": "95bc34e8-51d2-4a24-bf33-2dc41269f593"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:38:12.343099 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-5fba4f09-5da4-4922-9b50-8009d474b0fa req-868d504e-3eea-4c3a-8e12-d58162f3be02 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:12.344075 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-5fba4f09-5da4-4922-9b50-8009d474b0fa req-868d504e-3eea-4c3a-8e12-d58162f3be02 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:12.355365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-5fba4f09-5da4-4922-9b50-8009d474b0fa req-868d504e-3eea-4c3a-8e12-d58162f3be02 service nova] Creating event network-changed:95bc34e8-51d2-4a24-bf33-2dc41269f593 for instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 on hv-cinder-83979 May 31 18:38:12.361553 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-5fba4f09-5da4-4922-9b50-8009d474b0fa req-868d504e-3eea-4c3a-8e12-d58162f3be02 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030144 May 31 18:38:12.362156 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 508/1026] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:38:41.567381 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:41.568110 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=48 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:41.678280 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:41.678776 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:41.684784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:41.685235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:41.686011 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:41.687012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:41.717443 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-59c0fa88-a958-4083-ab8d-fa32bf6beea8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/ips" status: 200 len: 151 microversion: 2.20 time: 0.155282 May 31 18:38:41.718310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 519/1027] 10.222.0.17 () {60 vars in 1288 bytes} [Tue May 31 18:38:41 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/ips => generated 151 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 18:38:43.501108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:38:43.501727 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:43.503978 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=22 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:43.504631 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=50 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:38:43.510932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:43.511423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:43.512260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:43.512925 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:43.536367 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lazy-loading 'flavor' on Instance uuid b241e1cd-27dc-4da0-8ead-a04459aa7dcd {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:38:43.794748 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ab6823c9-1d0e-4471-af63-274a8d9d7684 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/action" status: 202 len: 0 microversion: 2.20 time: 0.298333 May 31 18:38:43.795375 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 509/1028] 10.222.0.17 () {62 vars in 1318 bytes} [Tue May 31 18:38:43 2022] POST /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 18:38:43.803704 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:43.804439 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:43.811257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:43.811853 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:43.812848 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:43.813293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:43.947241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:43.955819 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:43.957350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:43.958502 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c8d3648d-122a-4245-8e9d-0eb3c8aa5a5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.158772 May 31 18:38:43.959050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 520/1029] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:43 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:44.978552 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:44.979237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:44.986455 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:44.986900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:44.987651 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:44.988082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:45.119514 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:45.127415 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:45.128949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:45.130101 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-091f7a7a-1341-49bc-95b0-50ce358824af tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.156363 May 31 18:38:45.130656 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 510/1030] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:44 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:46.149312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:46.149947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:46.156206 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:46.156662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:46.157461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:46.157953 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:46.288009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:46.296482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:46.298099 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:46.299268 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6f0885cf-6990-46f7-8083-e7cbde7afe5e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.153875 May 31 18:38:46.299819 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 521/1031] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:46 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:47.317934 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:47.318478 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:47.325220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:47.325661 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:47.326466 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:47.326908 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:47.460376 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:47.468169 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:47.469674 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:47.470829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-08c001f5-7589-42bd-8dd6-3e9063c8231e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.156882 May 31 18:38:47.471372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 511/1032] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:47 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:38:48.489515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:48.490118 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:48.496645 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:48.497088 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:48.497841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:48.498270 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:48.625702 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:48.633753 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:48.635229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:48.636396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8c93856f-4318-4404-8743-b77c6d806e4c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.150733 May 31 18:38:48.636938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 522/1033] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:48 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:49.655803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:49.656563 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:49.663013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:49.663449 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:49.664224 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:49.664654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:49.796966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:49.804744 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:49.806234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:49.807377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6bf8a1b9-6eb3-4b25-8b80-ca122756208d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.156183 May 31 18:38:49.807931 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 512/1034] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:49 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:50.826064 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:50.826679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:50.833251 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:50.833703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:50.834477 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:50.834918 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:50.961633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:50.969893 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:50.971376 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:50.972607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a8bd5127-c492-473d-af46-f65e1ffcdf8a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.150477 May 31 18:38:50.973151 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 523/1035] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:50 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:51.990616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:51.991225 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:51.997636 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:51.998082 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:51.998836 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:51.999270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:52.130236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:52.138299 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:52.140441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:52.141595 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5dd33ecc-1610-4d85-9189-56e5fd0d15db tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.154918 May 31 18:38:52.142145 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 513/1036] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:51 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:53.160130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:53.160811 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:53.167975 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:53.168458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:53.169236 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:53.169679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:53.295730 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:53.305731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:53.307272 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:53.308479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b033be2d-3f72-4d3c-8df3-a9a64ca1f181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.152513 May 31 18:38:53.309032 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 524/1037] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:53 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:54.329584 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:54.330187 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:54.336879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:54.337317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:54.338071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:54.338499 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:54.472516 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:54.482835 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:54.484897 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:54.486140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d92c56ea-564f-4417-96ca-2760f41fe9a7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.161527 May 31 18:38:54.487236 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 514/1038] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:54 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:55.506540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:55.507147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:55.513872 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:55.514317 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:55.515083 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:55.515623 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:55.646910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:55.654675 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:55.656710 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:55.657964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-881b7339-a5fd-4e3f-979c-f537a87cab5a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1742 microversion: 2.20 time: 0.155287 May 31 18:38:55.658516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 525/1039] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:55 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1742 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:56.676820 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:56.677385 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:56.683950 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:56.684424 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:56.685192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:56.685630 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:56.815879 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:56.823729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:56.825246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:56.826386 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-41328d2b-783a-4902-b23e-e762892c27e8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1742 microversion: 2.20 time: 0.153542 May 31 18:38:56.826940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 515/1040] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:56 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1742 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:57.844906 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:57.845553 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:57.851990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:57.852477 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:57.853245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:57.853678 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:57.987862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:57.995934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:57.997473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:57.998631 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-62bbd67e-d722-4e61-b9d5-7e79848b9f65 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1742 microversion: 2.20 time: 0.157903 May 31 18:38:57.999186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 526/1041] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:57 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1742 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:59.018273 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:38:59.018883 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:38:59.025324 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:59.025777 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:59.026538 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:59.026976 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:59.154566 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:59.162591 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:59.164119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:38:59.165272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-67740bb9-5e49-4cac-9e4d-e35c2ce9b88c tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1742 microversion: 2.20 time: 0.151500 May 31 18:38:59.165914 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 516/1042] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:38:59 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:38:59.580211 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-524d1eef-01cf-48d0-9918-4ab2eb576779 req-e37bfe79-f34d-484a-9286-60cd7138c67a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "name": "network-vif-plugged", "status": "completed", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:38:59.589391 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-524d1eef-01cf-48d0-9918-4ab2eb576779 req-e37bfe79-f34d-484a-9286-60cd7138c67a service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:38:59.589976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-524d1eef-01cf-48d0-9918-4ab2eb576779 req-e37bfe79-f34d-484a-9286-60cd7138c67a service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:38:59.603127 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-524d1eef-01cf-48d0-9918-4ab2eb576779 req-e37bfe79-f34d-484a-9286-60cd7138c67a service nova] Creating event network-vif-plugged:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:38:59.609277 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-524d1eef-01cf-48d0-9918-4ab2eb576779 req-e37bfe79-f34d-484a-9286-60cd7138c67a service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033642 May 31 18:38:59.610150 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 527/1043] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:39:00.183089 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:00.183655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:00.190907 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:00.191354 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:00.192242 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:00.192679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:00.344051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:00.351959 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:00.353492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:00.354653 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3c0e118c-6852-4232-8b39-4d63fa434fda tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1742 microversion: 2.20 time: 0.175611 May 31 18:39:00.355206 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 517/1044] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:00 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1742 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:01.373473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:01.374161 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:01.381470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:01.381920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:01.382934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:01.383379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:01.517245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:01.525263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:01.526778 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:01.527944 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-fa086a10-2d4d-4b69-921a-be640bf6bb86 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.158720 May 31 18:39:01.528524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 528/1045] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:01 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:02.557484 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:02.558109 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:02.565769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:02.566469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:02.567453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:02.567895 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:02.727081 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:02.752464 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:02.754112 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:02.756698 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0ea0d850-c9a0-46b7-aae9-e4bf36b2938a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.204460 May 31 18:39:02.757257 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 518/1046] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:02 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:03.779124 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:03.779752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:03.788785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:03.789229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:03.790005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:03.790606 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:03.935805 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:03.946292 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:03.947819 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:03.949055 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4a86dad8-c85a-47ec-b932-2f736d12e1a5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.174125 May 31 18:39:03.949615 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 529/1047] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:03 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:04.968840 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:04.970277 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:04.977723 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:04.978523 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:04.979531 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:04.980061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:05.128244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:05.136541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:05.138307 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:05.139219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-87f245a9-63b8-4010-9fbb-781e7dbd381b tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.174902 May 31 18:39:05.140124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 519/1048] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:04 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:06.157588 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:06.158261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:06.165399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:06.165851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:06.166627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:06.167066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:06.314049 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:06.323113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:06.324757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:06.326107 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8dc0b17b-736b-4cc8-b1a0-893987372bf7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.172608 May 31 18:39:06.326742 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 530/1049] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:06 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:07.348238 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:07.349091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:07.357060 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:07.357596 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:07.358561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:07.359161 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:07.530960 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:07.540293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:07.541841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:07.543050 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8fd5defb-cd47-4948-8bfd-61d1c5e3d8d5 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.201963 May 31 18:39:07.543610 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 520/1050] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:07 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:08.562282 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:08.563196 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:08.570340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:08.570788 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:08.571821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:08.572449 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:08.717784 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:08.727640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:08.729426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:08.730593 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8c11bef1-ee7c-474a-ac9b-57ae5e13b842 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.172596 May 31 18:39:08.732135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 531/1051] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:08 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:09.750873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:09.751469 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:09.758191 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:09.758639 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:09.759389 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:09.759823 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:09.913014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:09.921754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:09.923805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:09.925048 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7580f085-2e85-423a-a6f2-e56c0a1f948d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.178414 May 31 18:39:09.927260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 521/1052] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:09 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:10.944265 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:10.944882 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:10.951333 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:10.951794 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:10.952641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:10.953079 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:11.079250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:11.087239 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:11.088903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:11.090067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ebd44ea2-1694-44be-b544-80495a94b181 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1737 microversion: 2.20 time: 0.149830 May 31 18:39:11.090617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 532/1053] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:10 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:12.109057 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:12.109660 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:12.115559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:12.116029 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:12.116800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:12.117231 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:12.248229 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:12.256923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:12.258707 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:12.259867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-42307a07-e359-477d-be7f-7ba48d814935 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1719 microversion: 2.20 time: 0.154883 May 31 18:39:12.260461 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 522/1054] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:12 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:13.279682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:13.280888 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:13.283836 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=29 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:39:13.288772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:13.289218 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:13.289983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:13.290414 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:13.293624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=79 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:39:13.426536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:13.434420 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:13.435909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:13.438039 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-cf31766d-9eeb-441d-9055-b6a352e693a9 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1719 microversion: 2.20 time: 0.163307 May 31 18:39:13.438620 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 533/1055] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:13 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1719 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:13.592304 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-bdf689d1-14a2-4b67-a25b-9aeb05d6cdf3 req-e48a980c-ee27-42ff-a0ba-6bc76cd0fe67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "name": "network-vif-unplugged", "status": "completed", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:39:13.596797 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=29 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:39:13.602617 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-bdf689d1-14a2-4b67-a25b-9aeb05d6cdf3 req-e48a980c-ee27-42ff-a0ba-6bc76cd0fe67 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:13.603079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-bdf689d1-14a2-4b67-a25b-9aeb05d6cdf3 req-e48a980c-ee27-42ff-a0ba-6bc76cd0fe67 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:13.606995 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:39:13.615101 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-bdf689d1-14a2-4b67-a25b-9aeb05d6cdf3 req-e48a980c-ee27-42ff-a0ba-6bc76cd0fe67 service nova] Creating event network-vif-unplugged:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:39:13.620659 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-bdf689d1-14a2-4b67-a25b-9aeb05d6cdf3 req-e48a980c-ee27-42ff-a0ba-6bc76cd0fe67 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031836 May 31 18:39:13.621352 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 523/1056] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:39:14.456759 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:14.457364 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:14.463925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:14.464403 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:14.465157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:14.465587 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:14.595652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:14.603389 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:14.604938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:14.606082 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8be537e8-7a5f-4619-92be-fa1125d000cd tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1662 microversion: 2.20 time: 0.153772 May 31 18:39:14.606624 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 534/1057] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:14 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1662 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:14.625480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f019cb33-e3a5-4e1d-bb47-d1d5a1b0f52d"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:39:14.626607 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:14.633932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:14.634384 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:14.635148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:14.635589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:14.911087 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-86465715-1355-4a23-8f48-5f9e5ac42aad tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.290751 May 31 18:39:14.911711 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 524/1058] 10.222.0.17 () {62 vars in 1363 bytes} [Tue May 31 18:39:14 2022] POST /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-volume_attachments => generated 188 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 18:39:15.024993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:15.025566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:15.032589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:15.033334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:15.034611 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:15.035355 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:15.268780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8e2b389c-d98b-44d6-ab7b-6b855caa66e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-volume_attachments/f019cb33-e3a5-4e1d-bb47-d1d5a1b0f52d" status: 202 len: 0 microversion: 2.20 time: 0.247607 May 31 18:39:15.269359 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 535/1059] 10.222.0.17 () {60 vars in 1456 bytes} [Tue May 31 18:39:15 2022] DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-volume_attachments/f019cb33-e3a5-4e1d-bb47-d1d5a1b0f52d => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 18:39:15.326374 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:39:15.326945 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:15.334316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:15.334769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:15.335539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:15.335986 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:15.417216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-594c41cc-a29a-476b-a236-71a5ff7885dc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "POST /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/action" status: 202 len: 0 microversion: 2.20 time: 0.094594 May 31 18:39:15.417720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 525/1060] 10.222.0.17 () {62 vars in 1318 bytes} [Tue May 31 18:39:15 2022] POST /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 18:39:15.426549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:15.427168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:15.433276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:15.433720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:15.434487 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:15.434923 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:15.572826 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:15.581014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:15.582515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:15.583675 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-645f1474-7787-4385-a2e9-797fb112b9e0 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1670 microversion: 2.20 time: 0.161089 May 31 18:39:15.584455 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 536/1061] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:15 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:16.603063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:16.603582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:16.611885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:16.611885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:16.612703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:16.613144 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:16.847219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:16.855167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:16.856810 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:16.858069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6de7f129-4a85-4313-91c6-818d4ab0776e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.259136 May 31 18:39:16.858868 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 526/1062] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:16 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:17.882508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:17.884196 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:17.893155 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:17.893934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:17.894870 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:17.895459 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:18.037479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:18.053367 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:18.054857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:18.056048 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2bcaaa71-bcf5-415a-8044-d024a22bc277 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.178401 May 31 18:39:18.056625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 537/1063] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:17 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:19.074484 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:19.075261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:19.081670 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:19.082124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:19.082929 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:19.083371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:19.232272 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:19.240830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:19.242317 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:19.243456 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-aee3d49b-9559-4566-9953-d478edeb6bd7 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.173167 May 31 18:39:19.244004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 527/1064] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:19 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:20.263041 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:20.263863 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:20.271662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:20.272139 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:20.272917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:20.273353 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:20.413718 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:20.421707 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:20.423266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:20.424556 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ad02e598-8993-4a7e-9b29-824b4cf4e537 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.165481 May 31 18:39:20.435276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 538/1065] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:20 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:21.444101 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:21.444915 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:21.452076 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:21.452559 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:21.453332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:21.453808 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:21.602194 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:21.611305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:21.612872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:21.614145 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-50a0e87f-a084-462a-b2fc-210213b697f8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.174722 May 31 18:39:21.614726 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 528/1066] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:21 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:22.634048 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:22.634742 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:22.641883 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:22.642774 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:22.643791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:22.644482 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:22.789350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:22.800484 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:22.802920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:22.805056 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5da44dcc-b3b3-4bb8-9024-ece2f89cd967 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.174577 May 31 18:39:22.805535 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 539/1067] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:22 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:23.846565 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:23.847244 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:23.853658 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:23.854100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:23.854854 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:23.855280 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:23.998968 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:24.009108 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:24.010618 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:24.011980 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-2c5b5a05-891e-44a8-8d9c-ab6be0da09cf tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.169868 May 31 18:39:24.012796 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 529/1068] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:23 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:39:25.030969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:25.031616 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:25.039364 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:25.039814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:25.040751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:25.041185 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:25.181903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:25.189681 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:25.191161 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:25.192335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d388ba2f-fac7-4cd1-af5a-afe191eee85f tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.165509 May 31 18:39:25.192875 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 540/1069] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:25 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:26.210786 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:26.211337 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:26.217885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:26.218330 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:26.219086 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:26.219540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:26.346699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:26.354474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:26.355966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:26.357134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5470c892-8f27-434f-aa56-4b70df77a24e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.150345 May 31 18:39:26.357688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 530/1070] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:26 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:27.375009 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:27.376812 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:27.383733 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:27.384210 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:27.384967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:27.385396 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:27.517002 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:27.527656 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:27.529263 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:27.530366 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-903d5e87-ae4c-4d18-9d31-f8b69b35fd93 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.159204 May 31 18:39:27.530914 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 541/1071] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:27 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:28.550495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:28.551092 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:28.557501 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:28.557948 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:28.558695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:28.559124 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:28.686377 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:28.694758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:28.696291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:28.697442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-caa1c33f-7516-490e-91fe-b80854a9e214 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.150941 May 31 18:39:28.697982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 531/1072] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:28 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:29.715960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:29.716557 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:29.724067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:29.724536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:29.725291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:29.725720 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:29.854044 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:29.862219 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:29.863735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:29.864903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-83f717e6-db9c-4745-a309-21c9b6c7d927 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.152894 May 31 18:39:29.865444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 542/1073] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:29 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:30.883217 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:30.883853 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:30.890261 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:30.890703 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:30.892049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:30.892560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:31.021910 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:31.029800 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:31.031335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:31.033348 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-6b291547-5bc7-4bf2-bd9f-3832c24c8c22 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.154296 May 31 18:39:31.033906 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 532/1074] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:30 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:32.051341 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:32.051945 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:32.058466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:32.058907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:32.059658 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:32.060105 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:32.190424 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:32.198245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:32.199731 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:32.200965 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c514692c-0970-4304-8a0b-046e785c007a tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.154080 May 31 18:39:32.201566 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 543/1075] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:32 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:33.218701 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:33.219784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:33.226007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:33.226457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:33.227216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:33.227648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:33.357627 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:33.366162 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:33.367665 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:33.368842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c2ad6707-f675-4419-8f58-0dbfc0438007 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.154062 May 31 18:39:33.369394 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 533/1076] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:33 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:33.711205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-9191ddb1-5828-490f-a051-fc47219fe097 req-5c041340-6424-4df8-a198-1cf8eea1a29c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "name": "network-vif-plugged", "status": "completed", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:39:33.720578 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-9191ddb1-5828-490f-a051-fc47219fe097 req-5c041340-6424-4df8-a198-1cf8eea1a29c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:33.721021 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-9191ddb1-5828-490f-a051-fc47219fe097 req-5c041340-6424-4df8-a198-1cf8eea1a29c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:33.732303 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-9191ddb1-5828-490f-a051-fc47219fe097 req-5c041340-6424-4df8-a198-1cf8eea1a29c service nova] Creating event network-vif-plugged:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:39:33.737565 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-9191ddb1-5828-490f-a051-fc47219fe097 req-5c041340-6424-4df8-a198-1cf8eea1a29c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030117 May 31 18:39:33.738299 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 544/1077] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:39:34.387826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:34.388458 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:34.395147 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:34.395590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:34.396371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:34.396803 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:34.524170 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:34.532599 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:34.534014 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:34.535156 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-efd5fa5a-f0f7-4b72-8b24-398476f90dba tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.151257 May 31 18:39:34.535706 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 534/1078] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:34 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:35.553814 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:35.554507 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:35.560744 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:35.561199 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:35.561954 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:35.562390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:35.693971 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:35.701868 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:35.704471 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:35.705314 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5f3c7776-e993-42cf-b64d-964ff6b2317d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1728 microversion: 2.20 time: 0.156308 May 31 18:39:35.706063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 545/1079] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:35 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:39:36.722988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:39:36.723652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:39:36.730234 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:36.730683 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:36.731439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:39:36.731875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:39:36.858467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:36.867058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:36.868599 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:39:36.869758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-27959478-6ff6-4387-89f7-ba3f34584809 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1715 microversion: 2.20 time: 0.150968 May 31 18:39:36.870312 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 535/1080] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:39:36 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1715 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:40:26.354598 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:26.355104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:26.357527 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=25 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:26.358174 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:26.364379 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:26.364830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:26.365594 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:26.366029 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:26.394228 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:40:26.466168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bae73201-4d59-4019-9875-bc5d8489131e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 204 len: 0 microversion: 2.1 time: 0.115069 May 31 18:40:26.466787 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 546/1081] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:40:26 2022] DELETE /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:40:26.478260 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:26.478868 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:26.481164 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=27 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:26.481799 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:26.488143 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:26.488577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:26.489397 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:26.489913 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:26.968896 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:26.976945 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4f21c36b-059f-498b-9079-cf38de6eb63e tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1578 microversion: 2.1 time: 0.502660 May 31 18:40:26.977503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 536/1082] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:26 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1578 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:27.995456 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:27.996212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:28.003521 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:28.003969 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:28.004762 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:28.005198 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:28.189061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:28.196536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a705624f-08ac-4669-8024-24ea775bd919 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1578 microversion: 2.1 time: 0.205423 May 31 18:40:28.197091 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 547/1083] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:27 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1578 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:29.213549 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:29.214775 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:29.221918 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:29.222373 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:29.223348 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:29.223789 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:29.287264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-8b2e81de-c386-4374-aa09-ae9418631bda req-97c9118f-a226-4472-aa5e-48d8663c33c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6528eeaf-9d4b-4360-8a1a-1f2b78983f95", "name": "network-vif-deleted", "tag": "95bc34e8-51d2-4a24-bf33-2dc41269f593"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:40:29.297164 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-8b2e81de-c386-4374-aa09-ae9418631bda req-97c9118f-a226-4472-aa5e-48d8663c33c4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:29.298650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-8b2e81de-c386-4374-aa09-ae9418631bda req-97c9118f-a226-4472-aa5e-48d8663c33c4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:29.307406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:29.310980 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-8b2e81de-c386-4374-aa09-ae9418631bda req-97c9118f-a226-4472-aa5e-48d8663c33c4 service nova] Creating event network-vif-deleted:95bc34e8-51d2-4a24-bf33-2dc41269f593 for instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 on hv-cinder-83979 May 31 18:40:29.317487 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-8b2e81de-c386-4374-aa09-ae9418631bda req-97c9118f-a226-4472-aa5e-48d8663c33c4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035577 May 31 18:40:29.318810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 548/1084] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:40:29.324625 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-35739c02-6ac8-4b04-9eee-a277b41c8442 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 200 len: 1510 microversion: 2.1 time: 0.115138 May 31 18:40:29.325417 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 537/1085] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:29 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 1510 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:30.342349 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:30.343061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:30.350097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:30.350641 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:30.351416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:30.351852 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:30.366622 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] HTTP exception thrown: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Request method failure captured: May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 HTTP/1.1 May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmBjgpvSmtG6hjqIY4alzZ20W4F-r15rqmbIsTvEW6mLIeCvAbTGv5wHW8QQ7v4CUjMvFujAqwf6_dQn9tIVTF1UJU1QaxfEYcmCn6kVSn98eORiQB7NFAQAKtGboncPIwqhniGPHB-pLWAqcU2jj4hyQWSpc_ghTjIWsASJhIwJTpM May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:40:30.368291 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-TestVolumeBootPattern-619990332 May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-TestVolumeBootPattern-619990332-project May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: ebcdfe9038fe4e0580a4fe79ae13e520 May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-TestVolumeBootPattern-619990332-project May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:40:30.369737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '6528eeaf-9d4b-4360-8a1a-1f2b78983f95'} May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:40:30.370574 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:40:30.373001 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:30.374752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Returning 404 to user: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:40:30.374752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-4f6dafb1-7c83-4796-9761-9c6cb003d047 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 404 len: 111 microversion: 2.1 time: 0.031878 May 31 18:40:30.374752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 549/1086] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:30 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:40:30.417087 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1132497150", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1714846868", "security_groups": [{"name": "tempest-secgroup-smoke-1499054043"}], "block_device_mapping_v2": [{"uuid": "f36fb93f-c89e-4a2e-a84d-fc98aad5bd7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1aa4c12e-adcc-4d8a-a0f1-1185914da5b1"}]}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:40:30.529369 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.network.neutron [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] validate_networks() for [('1aa4c12e-adcc-4d8a-a0f1-1185914da5b1', None, None, None, None, None)] {{(pid=117590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:40:30.935700 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Flavor limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:40:30.936146 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Image limits 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:40:30.936614 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Flavor pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:40:30.937018 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Image pref 0:0:0 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:40:30.937423 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.virt.hardware [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:40:30.946769 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:30.947209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:30.947991 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:30.948451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:30.964822 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:40:30.968664 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for user ebcdfe9038fe4e0580a4fe79ae13e520 and project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'ram', 'instances', 'cores'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:40:31.025241 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Going to run 1 instances... {{(pid=117590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:40:31.027368 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f36fb93f-c89e-4a2e-a84d-fc98aad5bd7a',volume_size=None,volume_type=None)] {{(pid=117590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:40:31.153300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4c03feda-30a7-4503-925b-0084711206f8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.739974 May 31 18:40:31.153935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 538/1087] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:40:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:40:31.164510 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-706ed7ea-b211-4598-a3e4-b2786f99a0c6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:31.165240 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-706ed7ea-b211-4598-a3e4-b2786f99a0c6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:31.224245 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-706ed7ea-b211-4598-a3e4-b2786f99a0c6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:31.230841 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-706ed7ea-b211-4598-a3e4-b2786f99a0c6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1095 microversion: 2.1 time: 0.070327 May 31 18:40:31.231387 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 550/1088] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:31 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:32.160495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:32.162621 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:32.170220 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.171482 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.172443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.173164 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.207773 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-77c8f4e5-a698-4188-8c2f-1a6a3e55fe5d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052295 May 31 18:40:32.209023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 539/1089] 10.222.0.17 () {60 vars in 1342 bytes} [Tue May 31 18:40:32 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:32.246691 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:32.247298 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:32.256399 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.257045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.257972 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.258795 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.268862 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:32.269451 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:32.275535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.276064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.276935 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.277444 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.303842 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:40:32.326467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:32.343499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2f95b434-a9e0-4201-8bd2-bddd587debe7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1211 microversion: 2.1 time: 0.100456 May 31 18:40:32.344161 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 551/1090] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:32 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:32.396208 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7fe7c9fc-ff2a-4a9e-8e71-4a8d2ea0e307 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 204 len: 0 microversion: 2.20 time: 0.132105 May 31 18:40:32.397109 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 540/1091] 10.222.0.17 () {60 vars in 1279 bytes} [Tue May 31 18:40:32 2022] DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 31 18:40:32.405907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:32.406774 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:32.414797 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.415372 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.416253 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:32.416703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:32.625232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:32.633255 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:32.635289 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:32.636551 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-aed5602d-4c67-4712-bab8-3f1553ae141d tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.234954 May 31 18:40:32.637168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 552/1092] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:32 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:40:33.362843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:33.364044 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:33.372470 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:33.372923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:33.373702 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:33.374141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:33.519084 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:33.529099 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-734ba3b2-77a6-47c1-a974-9d2eca7b73b6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1279 microversion: 2.1 time: 0.171825 May 31 18:40:33.529822 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 541/1093] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:33 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1279 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:33.655612 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:33.656316 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:33.664149 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:33.664771 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:33.665591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:33.666292 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:33.907835 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:33.916061 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:33.917617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:33.918960 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-bb563a10-f109-42db-95dd-a2ae1d9367fc tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.267452 May 31 18:40:33.919515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 553/1094] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:33 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:40:34.469829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-e9a28bfb-81d1-4349-8d69-8fa4d361478b req-dd1ec279-0a70-4b71-86c7-5c558b2ce84e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3993a76-46e5-432c-8d8e-8e6b8225c0e7", "tag": "79376145-16eb-461c-8516-feb786a6f974"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:40:34.483145 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-e9a28bfb-81d1-4349-8d69-8fa4d361478b req-dd1ec279-0a70-4b71-86c7-5c558b2ce84e service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:34.483577 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-e9a28bfb-81d1-4349-8d69-8fa4d361478b req-dd1ec279-0a70-4b71-86c7-5c558b2ce84e service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:34.497873 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-e9a28bfb-81d1-4349-8d69-8fa4d361478b req-dd1ec279-0a70-4b71-86c7-5c558b2ce84e service nova] Creating event network-changed:79376145-16eb-461c-8516-feb786a6f974 for instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 on hv-cinder-83979 May 31 18:40:34.503615 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-e9a28bfb-81d1-4349-8d69-8fa4d361478b req-dd1ec279-0a70-4b71-86c7-5c558b2ce84e service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038136 May 31 18:40:34.504480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 542/1095] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:40:34.546401 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:34.547020 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:34.554267 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:34.554708 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:34.555483 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:34.556112 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:34.922269 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:34.930321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f8e5f919-0b19-4eeb-a44a-756a4abca737 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.387756 May 31 18:40:34.930993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 554/1096] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:34 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:40:34.946513 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:34.947209 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:34.953443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:34.954039 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:34.954814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:34.955248 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:35.218279 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:35.226736 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:35.228425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:35.229585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-8afab3e6-e2dd-4f09-918d-3fa377643f73 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1721 microversion: 2.20 time: 0.287325 May 31 18:40:35.230139 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 543/1097] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:34 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 18:40:35.947461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:35.948200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:35.954881 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:35.955359 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:35.956715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:35.957230 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:36.246871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:36.247715 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:36.254751 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:36.255525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:36.256415 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:36.256869 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:36.297847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:36.299463 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:36.300142 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.objects.instance [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lazy-loading 'fault' on Instance uuid b241e1cd-27dc-4da0-8ead-a04459aa7dcd {{(pid=117590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:40:36.380792 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:36.392804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:36.394611 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eae1472e93fd44d5a621e03f2f2e8476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08edb56fe0174a94b32148eb8c6291d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:36.396560 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-29ffbb49-119d-4de4-bb34-77e6b138b2c8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 200 len: 1370 microversion: 2.20 time: 0.152838 May 31 18:40:36.396753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 544/1098] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:36 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 18:40:36.433386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:36.442097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-08d126ae-2fc6-4131-b386-654c0e14d236 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.498428 May 31 18:40:36.442663 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 555/1099] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:35 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:36.531094 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-bf859670-ee9c-4d37-99b8-c308415f9e85 req-b4dc5ad3-d485-4942-97e0-3ea705a8a3b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b241e1cd-27dc-4da0-8ead-a04459aa7dcd", "name": "network-vif-deleted", "tag": "d74dc564-6ca6-42b1-a45c-d7eb00e49687"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:40:36.541100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-bf859670-ee9c-4d37-99b8-c308415f9e85 req-b4dc5ad3-d485-4942-97e0-3ea705a8a3b0 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:36.545319 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-bf859670-ee9c-4d37-99b8-c308415f9e85 req-b4dc5ad3-d485-4942-97e0-3ea705a8a3b0 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:36.566378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-bf859670-ee9c-4d37-99b8-c308415f9e85 req-b4dc5ad3-d485-4942-97e0-3ea705a8a3b0 service nova] Creating event network-vif-deleted:d74dc564-6ca6-42b1-a45c-d7eb00e49687 for instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd on hv-cinder-83979 May 31 18:40:36.583628 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-bf859670-ee9c-4d37-99b8-c308415f9e85 req-b4dc5ad3-d485-4942-97e0-3ea705a8a3b0 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056243 May 31 18:40:36.584452 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 545/1100] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:40:37.414322 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:37.414883 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:37.421791 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:37.432340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:37.432340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:37.432340 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:37.443614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] HTTP exception thrown: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Request method failure captured: May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd HTTP/1.1 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill9kQCepYN5928b5nUo59-e5Sa-wfo6WdS0QOvRl5r4UGiPZcY88L0Ion4cc8MM1G-SyrfJLRDplDBG4A879CB0IqoqpC6OOleckbb0JcUPTY2fymy5BFb-DXJSQ-XXyjNWPJMSSRZz-s0dbgSV_yaMMRchQyL28sKL_1aI6ekQyvNk May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Openstack-Nova-Api-Version: 2.20 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:40:37.445188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: eae1472e93fd44d5a621e03f2f2e8476 May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:37.446922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'b241e1cd-27dc-4da0-8ead-a04459aa7dcd'} May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:40:37.451365 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:37.454604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:37.455990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Returning 404 to user: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:40:37.455990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6b946b35-e0d1-4791-b11d-e60de9f0fa17 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 404 len: 111 microversion: 2.20 time: 0.036242 May 31 18:40:37.455990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 556/1101] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:37 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 18:40:37.456450 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-1d8e4787-7eb9-45f9-86ab-42cf2126d7b8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '.version_select at 0x7ffb74d701f0>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:37.458393 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:37.459004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:37.465749 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:37.466204 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:37.466990 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:37.467427 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:37.476069 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-1d8e4787-7eb9-45f9-86ab-42cf2126d7b8 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-91458027" status: 204 len: 0 microversion: 2.20 time: 0.024123 May 31 18:40:37.476761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 546/1102] 10.222.0.17 () {60 vars in 1255 bytes} [Tue May 31 18:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-91458027 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 31 18:40:37.611755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:37.619630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-f9eb85f9-a0fb-4a21-95e6-5dc81410e78b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.164943 May 31 18:40:37.620408 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 557/1103] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:37 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:40:38.637169 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:38.637894 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:38.645037 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:38.645480 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:38.646228 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:38.646663 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:38.781248 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:38.788865 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7d35ae3a-54fb-400e-a7fe-992578f16394 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.156260 May 31 18:40:38.789421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 547/1104] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:38 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:39.240201 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:39.240682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:39.247066 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:39.247509 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:39.248292 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:39.248722 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:39.262394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] HTTP exception thrown: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Request method failure captured: May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd HTTP/1.1 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill9kQCepYN5928b5nUo59-e5Sa-wfo6WdS0QOvRl5r4UGiPZcY88L0Ion4cc8MM1G-SyrfJLRDplDBG4A879CB0IqoqpC6OOleckbb0JcUPTY2fymy5BFb-DXJSQ-XXyjNWPJMSSRZz-s0dbgSV_yaMMRchQyL28sKL_1aI6ekQyvNk May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Openstack-Nova-Api-Version: 2.20 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:40:39.263909 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: eae1472e93fd44d5a621e03f2f2e8476 May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.265652 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'b241e1cd-27dc-4da0-8ead-a04459aa7dcd'} May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:40:39.266745 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.268229 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:39.269735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Returning 404 to user: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:40:39.269735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c8a0c943-65ee-49c3-ab20-3a8f664c51e2 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 404 len: 111 microversion: 2.20 time: 0.028993 May 31 18:40:39.269735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 558/1105] 10.222.0.17 () {60 vars in 1279 bytes} [Tue May 31 18:40:39 2022] DELETE /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 18:40:39.273655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:39.274265 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: b241e1cd-27dc-4da0-8ead-a04459aa7dcd] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:39.280267 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:39.280712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:39.281474 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:39.282064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:39.295791 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] HTTP exception thrown: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Request method failure captured: May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd HTTP/1.1 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill9kQCepYN5928b5nUo59-e5Sa-wfo6WdS0QOvRl5r4UGiPZcY88L0Ion4cc8MM1G-SyrfJLRDplDBG4A879CB0IqoqpC6OOleckbb0JcUPTY2fymy5BFb-DXJSQ-XXyjNWPJMSSRZz-s0dbgSV_yaMMRchQyL28sKL_1aI6ekQyvNk May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Openstack-Nova-Api-Version: 2.20 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:40:39.298022 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: eae1472e93fd44d5a621e03f2f2e8476 May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.299787 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'b241e1cd-27dc-4da0-8ead-a04459aa7dcd'} May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:40:39.300754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. May 31 18:40:39.302239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:39.303598 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Returning 404 to user: Instance b241e1cd-27dc-4da0-8ead-a04459aa7dcd could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:40:39.303598 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-fd49065a-8e87-46da-a8b9-0419cec99f1e tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd" status: 404 len: 111 microversion: 2.20 time: 0.029583 May 31 18:40:39.303598 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 548/1106] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:39 2022] GET /compute/v2.1/servers/b241e1cd-27dc-4da0-8ead-a04459aa7dcd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 18:40:39.805740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:39.806347 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:39.812563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:39.813146 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:39.813907 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:39.814337 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:39.944383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:39.951677 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e921d728-7b1d-40dc-ae24-2455f1febfcf tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.149824 May 31 18:40:39.952255 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 559/1107] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:39 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:40.433004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:40.433535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:40.440511 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:40.440965 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:40.441730 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:40.442170 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:40.459211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] HTTP exception thrown: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Request method failure captured: May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 HTTP/1.1 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABill9kQCepYN5928b5nUo59-e5Sa-wfo6WdS0QOvRl5r4UGiPZcY88L0Ion4cc8MM1G-SyrfJLRDplDBG4A879CB0IqoqpC6OOleckbb0JcUPTY2fymy5BFb-DXJSQ-XXyjNWPJMSSRZz-s0dbgSV_yaMMRchQyL28sKL_1aI6ekQyvNk May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Openstack-Nova-Api-Version: 2.20 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:40:40.460781 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: eae1472e93fd44d5a621e03f2f2e8476 May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.462245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'd4134a34-2a85-4a0b-96fd-f221227ee2c4'} May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:40:40.463006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.464567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:40:40.466183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Returning 404 to user: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:40:40.466183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c00f7673-5fb5-4e0a-86e8-0beac4654a11 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 404 len: 111 microversion: 2.20 time: 0.033673 May 31 18:40:40.466183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 549/1108] 10.222.0.17 () {60 vars in 1279 bytes} [Tue May 31 18:40:40 2022] DELETE /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 18:40:40.470716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:40.471350 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] [instance: d4134a34-2a85-4a0b-96fd-f221227ee2c4] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:40.477755 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:40.478202 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:40.478957 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:40.479388 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:40.492529 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] HTTP exception thrown: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Request method failure captured: May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 HTTP/1.1 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABill9kQCepYN5928b5nUo59-e5Sa-wfo6WdS0QOvRl5r4UGiPZcY88L0Ion4cc8MM1G-SyrfJLRDplDBG4A879CB0IqoqpC6OOleckbb0JcUPTY2fymy5BFb-DXJSQ-XXyjNWPJMSSRZz-s0dbgSV_yaMMRchQyL28sKL_1aI6ekQyvNk May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Openstack-Nova-Api-Version: 2.20 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:40:40.494025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/08edb56fe0174a94b32148eb8c6291d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 08edb56fe0174a94b32148eb8c6291d3 May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1928702277 May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: eae1472e93fd44d5a621e03f2f2e8476 May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1928702277-project May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.495712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': 'd4134a34-2a85-4a0b-96fd-f221227ee2c4'} May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:40:40.496523 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. May 31 18:40:40.497790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:40:40.498856 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] Returning 404 to user: Instance d4134a34-2a85-4a0b-96fd-f221227ee2c4 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:40:40.498856 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2bf4a753-0868-465c-b65f-06434ea041e1 tempest-AttachVolumeShelveTestJSON-1928702277 tempest-AttachVolumeShelveTestJSON-1928702277-project] 10.222.0.17 "GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4" status: 404 len: 111 microversion: 2.20 time: 0.028611 May 31 18:40:40.498856 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 560/1109] 10.222.0.17 () {60 vars in 1276 bytes} [Tue May 31 18:40:40 2022] GET /compute/v2.1/servers/d4134a34-2a85-4a0b-96fd-f221227ee2c4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 31 18:40:40.968768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:40.969969 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:40.972080 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=2 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:40.976144 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:40.978589 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:40.979033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:40.979795 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:40.980264 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:41.121872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:41.129650 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cc49b1bf-e4a9-4555-91ff-6dab87e9ccb2 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.164692 May 31 18:40:41.130219 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 550/1110] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:40 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:42.148126 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:42.150045 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:42.158601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:40:42.162437 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:42.163677 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:42.165154 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:42.166091 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:42.410385 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:42.418576 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-088ce361-f0c7-4362-b6d6-e35f5f9be52c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.275031 May 31 18:40:42.419130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 561/1111] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:42 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:43.434652 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:43.435292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:43.441453 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:43.441904 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:43.442732 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:43.443106 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:43.693421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:43.714333 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-57f83029-df3f-4553-a056-421dec588fdd tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.283254 May 31 18:40:43.715332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 551/1112] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:43 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:44.081491 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-f28bcf05-0725-4c03-8fef-0831a37cc37c req-9edc4c86-4d8d-453b-b34f-3e02cbdfd423 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3993a76-46e5-432c-8d8e-8e6b8225c0e7", "name": "network-vif-plugged", "status": "completed", "tag": "79376145-16eb-461c-8516-feb786a6f974"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:40:44.094496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-f28bcf05-0725-4c03-8fef-0831a37cc37c req-9edc4c86-4d8d-453b-b34f-3e02cbdfd423 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:44.094933 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-f28bcf05-0725-4c03-8fef-0831a37cc37c req-9edc4c86-4d8d-453b-b34f-3e02cbdfd423 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:44.108047 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-f28bcf05-0725-4c03-8fef-0831a37cc37c req-9edc4c86-4d8d-453b-b34f-3e02cbdfd423 service nova] Creating event network-vif-plugged:79376145-16eb-461c-8516-feb786a6f974 for instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 on hv-cinder-83979 May 31 18:40:44.114058 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-f28bcf05-0725-4c03-8fef-0831a37cc37c req-9edc4c86-4d8d-453b-b34f-3e02cbdfd423 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036923 May 31 18:40:44.114644 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 562/1113] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:40:44.731708 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:44.732434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:44.739390 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:44.739846 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:44.740649 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:44.741222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:44.882941 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:44.891678 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cbfaec58-83b2-41d0-a258-6056f6ccdd8f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1267 microversion: 2.1 time: 0.164268 May 31 18:40:44.892425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 552/1114] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:44 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:45.909609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:45.910325 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:45.918153 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:45.918715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:45.919501 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:45.919950 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:46.059071 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:46.068801 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2d26d5c1-87f3-47b1-868a-977d1da56a76 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1455 microversion: 2.1 time: 0.163388 May 31 18:40:46.069371 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 563/1115] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:45 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1455 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:46.085545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:40:46.086149 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:40:46.092502 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:46.092949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:46.093695 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:46.094227 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:46.223640 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:40:46.231104 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0c4e55aa-102b-4a1c-b2aa-d345d1905bb8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1455 microversion: 2.1 time: 0.149328 May 31 18:40:46.231662 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 553/1116] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:40:46 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1455 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:40:47.857879 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-c8ce0468-53bd-4fc7-8982-5076da687dfc req-b17421d2-d2a7-4502-9f3b-f5c5ec2c3b59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3993a76-46e5-432c-8d8e-8e6b8225c0e7", "tag": "79376145-16eb-461c-8516-feb786a6f974"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:40:47.867993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-c8ce0468-53bd-4fc7-8982-5076da687dfc req-b17421d2-d2a7-4502-9f3b-f5c5ec2c3b59 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:40:47.868472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-c8ce0468-53bd-4fc7-8982-5076da687dfc req-b17421d2-d2a7-4502-9f3b-f5c5ec2c3b59 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:40:47.879844 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-c8ce0468-53bd-4fc7-8982-5076da687dfc req-b17421d2-d2a7-4502-9f3b-f5c5ec2c3b59 service nova] Creating event network-changed:79376145-16eb-461c-8516-feb786a6f974 for instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 on hv-cinder-83979 May 31 18:40:47.885117 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-c8ce0468-53bd-4fc7-8982-5076da687dfc req-b17421d2-d2a7-4502-9f3b-f5c5ec2c3b59 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031030 May 31 18:40:47.885697 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 564/1117] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:41:36.403485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3f512251-635f-40cd-bacd-07a0345cf2a9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Action: 'create', calling method: .version_select at 0x7ffb6efdc670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-741467099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHa2mYW7rgj8jNicx8j4q8winh8lx39eUATv5LZ1wYBIMtHCOCh+/RMYl8oCElWJmOgRrqdgMH7aS8UJH9rNL8iMuMb+F61YbIhJVBd6NIm6Qu63WWJqZ7s9l0RqA14zkw=="}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:41:36.408881 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:36.409693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:36.427804 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-3f512251-635f-40cd-bacd-07a0345cf2a9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Getting quotas for project 78fa27d3fa4d47c29d8ec70e7f486638. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:41:36.432012 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.quota [None req-3f512251-635f-40cd-bacd-07a0345cf2a9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Getting quotas for user 0b2d334ac2d14ba78886a59425e8ad1b and project 78fa27d3fa4d47c29d8ec70e7f486638. Resources: {'key_pairs'} {{(pid=117590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:41:36.454009 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3f512251-635f-40cd-bacd-07a0345cf2a9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.054371 May 31 18:41:36.455094 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 554/1118] 10.222.0.17 () {60 vars in 1158 bytes} [Tue May 31 18:41:36 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:41:36.502124 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:36.502898 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:36.506911 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1385752085", "imageRef": "e2bcb3fb-aee9-4c8f-a82f-2459bedbcabf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-741467099", "networks": [{"uuid": "35c05f61-b33d-4abf-a273-9c560097d4fe"}]}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:41:36.567395 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] validate_networks() for [('35c05f61-b33d-4abf-a273-9c560097d4fe', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:41:36.938202 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:41:36.938627 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:41:36.939710 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:41:36.940149 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:41:36.940567 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:41:36.949917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:36.950410 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:36.951186 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:36.951619 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:36.968373 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Getting quotas for project 78fa27d3fa4d47c29d8ec70e7f486638. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:41:36.972479 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Getting quotas for user 0b2d334ac2d14ba78886a59425e8ad1b and project 78fa27d3fa4d47c29d8ec70e7f486638. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:41:36.983162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:41:36.985437 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e2bcb3fb-aee9-4c8f-a82f-2459bedbcabf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:41:37.029114 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9f4b8a76-863a-4fea-8518-12cb8a04181c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528741 May 31 18:41:37.029738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 565/1119] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:41:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:41:37.039643 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4f159d9b-d527-4203-8a7e-a0003bcaca4c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:37.040282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4f159d9b-d527-4203-8a7e-a0003bcaca4c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:37.093353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4f159d9b-d527-4203-8a7e-a0003bcaca4c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:37.100048 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4f159d9b-d527-4203-8a7e-a0003bcaca4c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1258 microversion: 2.1 time: 0.064285 May 31 18:41:37.100632 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 555/1120] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:37 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1258 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:38.118153 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:38.118846 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:38.125224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:38.125671 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:38.126444 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:38.126931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:38.211394 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:38.218679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-03635418-fb69-4d7d-9b3a-6d3e97fbac77 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1316 microversion: 2.1 time: 0.105375 May 31 18:41:38.219232 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 566/1121] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:38 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1316 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:39.237431 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:39.238676 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:39.246673 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:39.247376 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:39.248176 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:39.248724 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:39.300515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:41:39.301190 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:41:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:41:39.407326 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:39.415222 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b7f1f5cd-1a1e-4c89-bbb7-bf608c5faf2e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.182390 May 31 18:41:39.415805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 556/1122] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:39 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:40.432877 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:40.433516 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:40.440261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:40.440712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:40.441474 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:40.441903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:40.578157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:40.586184 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e4bdfcd4-955d-4023-bfab-22d4ad077328 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.157234 May 31 18:41:40.586741 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 567/1123] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:40 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:41.607845 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:41.608921 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:41.626456 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:41.627450 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:41.628681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:41.629412 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:41.780258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:41.788527 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-528efa81-2611-49cd-8f94-759930e1d8d6 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.188851 May 31 18:41:41.789185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 557/1124] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:41 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:41:42.806441 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:42.808157 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:42.815377 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:42.816312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:42.817189 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:42.817737 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:42.957463 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:42.965681 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-25eae3cc-06a3-4c18-97d1-81efaa7d268d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.163407 May 31 18:41:42.977330 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 568/1125] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:42 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:43.984933 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:43.985620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:43.996697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:43.997275 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:43.997989 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:43.998418 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:44.142032 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:44.149940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a48381b5-7e6e-4703-ac9d-f49d88178b18 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.168747 May 31 18:41:44.150508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 558/1126] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:43 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:41:45.166765 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:45.167383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:45.173736 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:45.174188 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:45.175637 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:45.176127 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:45.311883 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:45.320407 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2464d539-c627-4f33-84d6-c87ceb3f7d7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.157658 May 31 18:41:45.320972 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 569/1127] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:45 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:46.338077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:46.338699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:46.346013 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:46.346841 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:46.347263 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:46.347829 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:46.482118 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:46.490459 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0e6e45e4-bd6f-447b-9f30-f1bfa6c15b05 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.156948 May 31 18:41:46.491017 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 559/1128] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:46 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:47.508369 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:47.509240 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:47.511466 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:47.512235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=6 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:47.518687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:47.519147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:47.519917 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:47.520383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:47.655579 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:47.663429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0c112a5a-1525-419d-b9d1-df496672d9ed tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.158949 May 31 18:41:47.663984 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 570/1129] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:47 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:48.679936 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:48.680503 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:48.682279 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=6 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:41:48.688037 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:48.688507 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:48.689256 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:48.689688 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:48.820726 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:48.828048 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cb76b0ed-6c69-48df-b60d-659c51a95cb9 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.152057 May 31 18:41:48.828616 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 560/1130] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:48 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:49.844647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:49.845212 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:49.851621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:49.852072 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:49.852958 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:49.853536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:50.049138 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:50.062266 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e971bcf4-352c-4eaa-8189-dc93ea310bca tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.221470 May 31 18:41:50.065320 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 571/1131] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:49 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:50.449518 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-e9995512-2870-4a87-ac18-6aae0bdd6093 req-270ecf45-01d3-4544-b2bb-f6f98fef7329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:41:50.459010 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-e9995512-2870-4a87-ac18-6aae0bdd6093 req-270ecf45-01d3-4544-b2bb-f6f98fef7329 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:50.459677 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-e9995512-2870-4a87-ac18-6aae0bdd6093 req-270ecf45-01d3-4544-b2bb-f6f98fef7329 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:50.471300 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-e9995512-2870-4a87-ac18-6aae0bdd6093 req-270ecf45-01d3-4544-b2bb-f6f98fef7329 service nova] Creating event network-changed:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:41:50.476958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-e9995512-2870-4a87-ac18-6aae0bdd6093 req-270ecf45-01d3-4544-b2bb-f6f98fef7329 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198029 May 31 18:41:50.477556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 561/1132] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:41:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:41:51.081730 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:51.082345 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:51.089424 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:51.089872 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:51.090630 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:51.091065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:51.218614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:51.226617 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-8d66436f-45a1-4edb-bf14-63ca8d6ddf99 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.148951 May 31 18:41:51.227169 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 572/1133] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:51 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:52.243875 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:52.244593 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:52.251119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:52.251561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:52.252345 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:52.252780 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:52.382437 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:52.389976 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-5964cb70-fca8-48f9-9fe1-b4c7352b7c7c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.150276 May 31 18:41:52.390529 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 562/1134] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:52 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:53.407120 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:53.407735 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:53.414839 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:53.415287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:53.416050 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:53.416514 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:53.546382 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:53.554378 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9a1f8a70-5e02-4d49-a066-4e4ff1c55124 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.151109 May 31 18:41:53.554938 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 573/1135] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:53 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:54.571006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:54.571626 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:54.578168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:54.578620 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:54.579393 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:54.579827 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:54.710063 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:54.717557 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-d360edee-4e98-4df2-a01e-b6632472fa07 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.150387 May 31 18:41:54.718061 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 563/1136] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:54 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:55.734738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:55.735380 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:55.742478 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:55.742925 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:55.743687 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:55.744142 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:55.874336 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:55.881647 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-116d84b4-04c4-4b13-aaf7-14f085be9a8e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.150805 May 31 18:41:55.882193 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 574/1137] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:55 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:56.367007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-3ad9bd35-e787-46c0-81bb-348c5540c899 req-bf902a63-9908-4a3b-8b4b-4d6cec14994d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "name": "network-vif-plugged", "status": "completed", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:41:56.376545 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-3ad9bd35-e787-46c0-81bb-348c5540c899 req-bf902a63-9908-4a3b-8b4b-4d6cec14994d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:56.376985 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-3ad9bd35-e787-46c0-81bb-348c5540c899 req-bf902a63-9908-4a3b-8b4b-4d6cec14994d service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:56.390461 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-3ad9bd35-e787-46c0-81bb-348c5540c899 req-bf902a63-9908-4a3b-8b4b-4d6cec14994d service nova] Creating event network-vif-plugged:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:41:56.396331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-3ad9bd35-e787-46c0-81bb-348c5540c899 req-bf902a63-9908-4a3b-8b4b-4d6cec14994d service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 May 31 18:41:56.397232 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 564/1138] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:41:56.898591 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:56.899121 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:56.905593 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:56.906040 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:56.906798 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:56.907231 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:57.037307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:57.049830 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1b5c60f6-dcfa-4c1c-8611-7524bc7a6ea5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.155224 May 31 18:41:57.050919 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 575/1139] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:56 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:41:58.067657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:58.068372 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:58.075041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:58.075484 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:58.076284 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:58.076720 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:58.211036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:58.219365 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-96ac62af-c13e-47a2-9def-4c00c30e2139 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1358 microversion: 2.1 time: 0.156162 May 31 18:41:58.219942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 565/1140] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:58 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:59.236815 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:59.237790 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:59.244580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.245016 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.245813 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.246250 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.374847 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:59.382887 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-02316f24-0a48-451f-ac24-3e1dd972a7c4 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1548 microversion: 2.1 time: 0.149899 May 31 18:41:59.383438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 576/1141] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:59 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:59.399689 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:59.400331 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:59.406701 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.407141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.407889 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.408353 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.540967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:59.548248 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-31dcbdec-96bf-4c2b-a5c5-5627070d5e5d tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1548 microversion: 2.1 time: 0.152428 May 31 18:41:59.548805 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 566/1142] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:59 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:41:59.563589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:59.567646 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:59.568428 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Searching by: {'deleted': False, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638'} {{(pid=117589) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 31 18:41:59.574827 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.575264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.576043 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.576496 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.668160 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.multi_cell_list [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 31 18:41:59.759203 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-27a9836c-4dc3-4401-97b8-9f73997a1125 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.198959 May 31 18:41:59.759769 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 577/1143] 10.222.0.17 () {58 vars in 1124 bytes} [Tue May 31 18:41:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:41:59.770492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:41:59.771100 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:41:59.776967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.777406 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.778155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:41:59.778586 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:41:59.904550 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:41:59.912271 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7f5cad17-f649-44c6-89e2-4433fd89a875 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1548 microversion: 2.1 time: 0.145954 May 31 18:41:59.912826 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 567/1144] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:41:59 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:42:01.430782 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "19b1e916-d5f3-486d-8f22-bd3127c53634"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:42:01.432680 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:42:01.441716 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:01.442221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:01.442998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:01.443434 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:01.697467 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2293d57e-afa4-4183-b462-98683632964a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273998 May 31 18:42:01.698086 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 578/1145] 10.222.0.17 () {60 vars in 1322 bytes} [Tue May 31 18:42:01 2022] POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:42:09.242392 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:42:09.242998 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:42:09.245982 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:42:09.251375 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:09.251824 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:09.252630 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:09.253058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:09.258525 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=65 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:42:09.388216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:42:09.396940 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-521b5fde-da3e-496b-8f4c-ba768edc0896 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1594 microversion: 2.1 time: 0.158330 May 31 18:42:09.397686 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 568/1146] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:42:09 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:42:11.358505 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-1ff46fe5-32fa-46ea-9f97-20faf63cc2f0 req-0c19a9cb-378d-4653-9345-935948b8f201 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:42:11.363776 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:42:11.364975 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:42:11.369955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1ff46fe5-32fa-46ea-9f97-20faf63cc2f0 req-0c19a9cb-378d-4653-9345-935948b8f201 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:11.370404 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-1ff46fe5-32fa-46ea-9f97-20faf63cc2f0 req-0c19a9cb-378d-4653-9345-935948b8f201 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:11.385028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:42:11.387549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-1ff46fe5-32fa-46ea-9f97-20faf63cc2f0 req-0c19a9cb-378d-4653-9345-935948b8f201 service nova] Creating event network-changed:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:42:11.392621 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-1ff46fe5-32fa-46ea-9f97-20faf63cc2f0 req-0c19a9cb-378d-4653-9345-935948b8f201 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037933 May 31 18:42:11.393542 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 579/1147] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:42:12.437335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-65708930"}} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:42:12.437927 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:42:12.446822 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:12.450899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:12.450899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:12.450899 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:12.586602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.network.security_group_api [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Adding security group 6301b20e-003c-4dce-af09-262b5896aedf to port b7722726-cc80-4fe2-b26f-d0e2a385fdfb May 31 18:42:12.965148 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c590241e-3259-404b-9ddf-6235573ef27f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/action" status: 202 len: 0 microversion: 2.1 time: 0.532050 May 31 18:42:12.967007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 569/1148] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:42:12 2022] POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 18:42:12.978597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:42:12.979301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:42:12.987214 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:12.987672 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:12.988655 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:12.990264 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:13.161955 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:42:13.170312 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-fe08a970-2576-46f1-ad30-15c33a24778a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1757 microversion: 2.1 time: 0.197659 May 31 18:42:13.172143 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 580/1149] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:42:12 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:42:13.409704 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-51f581c3-3c55-48c8-adc9-02cbba85fb8c req-559dc5f6-10c9-4662-8ad7-70b0ae5e832c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:42:13.425648 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-51f581c3-3c55-48c8-adc9-02cbba85fb8c req-559dc5f6-10c9-4662-8ad7-70b0ae5e832c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:42:13.426256 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-51f581c3-3c55-48c8-adc9-02cbba85fb8c req-559dc5f6-10c9-4662-8ad7-70b0ae5e832c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:42:13.441067 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-51f581c3-3c55-48c8-adc9-02cbba85fb8c req-559dc5f6-10c9-4662-8ad7-70b0ae5e832c service nova] Creating event network-changed:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:42:13.447442 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-51f581c3-3c55-48c8-adc9-02cbba85fb8c req-559dc5f6-10c9-4662-8ad7-70b0ae5e832c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041405 May 31 18:42:13.448155 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 570/1150] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:43:00.470571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-163385775", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1714846868", "security_groups": [{"name": "tempest-secgroup-smoke-1499054043"}], "block_device_mapping_v2": [{"uuid": "21aa41c6-2b20-4035-ac73-3b4f3ef9277a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1aa4c12e-adcc-4d8a-a0f1-1185914da5b1"}]}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:43:00.479713 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:00.480383 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=7 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:00.588640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.network.neutron [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] validate_networks() for [('1aa4c12e-adcc-4d8a-a0f1-1185914da5b1', None, None, None, None, None)] {{(pid=117589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 18:43:00.993200 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Flavor limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 18:43:00.994201 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Image limits 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 18:43:00.994679 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Flavor pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 18:43:00.995089 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Image pref 0:0:0 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 18:43:00.995499 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.virt.hardware [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 18:43:01.004165 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:01.004607 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:01.005390 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:01.005821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:01.022983 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 18:43:01.031873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.quota [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Getting quotas for user ebcdfe9038fe4e0580a4fe79ae13e520 and project 6710d1fa5fbb49c28aa55ae4cd810dc7. Resources: {'ram', 'instances', 'cores'} {{(pid=117589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 18:43:01.090662 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Going to run 1 instances... {{(pid=117589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 18:43:01.092763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21aa41c6-2b20-4035-ac73-3b4f3ef9277a',volume_size=None,volume_type=None)] {{(pid=117589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 18:43:01.222508 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-56253a7f-a5e7-4c5d-97a5-150c439af8d6 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.755879 May 31 18:43:01.223135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 581/1151] 10.222.0.17 () {60 vars in 1146 bytes} [Tue May 31 18:43:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 757 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 18:43:01.231739 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=5 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:01.232521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=11 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:01.237135 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-c1e42f89-f68e-4a4f-b18f-cd4232a4f027 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:01.238066 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-c1e42f89-f68e-4a4f-b18f-cd4232a4f027 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:01.297172 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-c1e42f89-f68e-4a4f-b18f-cd4232a4f027 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:01.303761 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-c1e42f89-f68e-4a4f-b18f-cd4232a4f027 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1094 microversion: 2.1 time: 0.073868 May 31 18:43:01.304349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 571/1152] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:01 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1094 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:02.321835 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9bbf0feb-3a98-429e-9120-30f9a2abbec8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:02.322931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9bbf0feb-3a98-429e-9120-30f9a2abbec8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:02.375014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9bbf0feb-3a98-429e-9120-30f9a2abbec8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:02.381682 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9bbf0feb-3a98-429e-9120-30f9a2abbec8 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1094 microversion: 2.1 time: 0.064263 May 31 18:43:02.382257 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 582/1153] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:02 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:03.398470 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-55960d61-6384-4f74-84e7-211e8f6ef2d7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:03.399088 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-55960d61-6384-4f74-84e7-211e8f6ef2d7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:03.460143 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-55960d61-6384-4f74-84e7-211e8f6ef2d7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:03.467657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-55960d61-6384-4f74-84e7-211e8f6ef2d7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1094 microversion: 2.1 time: 0.073069 May 31 18:43:03.468253 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 572/1154] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:03 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:04.484871 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ae22cb5b-48fc-4de2-bba6-b4de94e26f6f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:04.485485 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ae22cb5b-48fc-4de2-bba6-b4de94e26f6f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:04.537795 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ae22cb5b-48fc-4de2-bba6-b4de94e26f6f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:04.545256 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ae22cb5b-48fc-4de2-bba6-b4de94e26f6f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1094 microversion: 2.1 time: 0.064255 May 31 18:43:04.545816 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 583/1155] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:04 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:05.562443 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:05.563070 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:05.569693 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:05.570140 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:05.570957 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:05.571492 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:05.633349 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:05.641602 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-3f205433-4272-43f2-8fc6-ac737456aa7f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1144 microversion: 2.1 time: 0.083012 May 31 18:43:05.642163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 573/1156] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:05 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:06.657317 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:06.657922 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:06.664632 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:06.665124 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:06.665959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:06.666492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:06.743828 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:06.751867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-97aea183-96fa-4cc0-b6f6-38bfb6897b64 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1210 microversion: 2.1 time: 0.098264 May 31 18:43:06.753601 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 584/1157] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:06 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:07.770974 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:07.771751 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:07.779359 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:07.779592 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:07.781493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:07.781942 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:07.981657 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:07.989509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-0ac37c08-8d9d-4197-9a61-80d93c019726 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.222469 May 31 18:43:07.990089 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 574/1158] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:07 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:43:08.104505 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-22689645-6b66-44b1-b7bd-13c9f7b584e9 req-9f10e52b-30ac-4f92-abd9-5c6a1a484b84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17be328c-59cf-41ba-a42b-8ac4044afbe7", "tag": "044d2673-4780-4c56-a1dd-2017aeb96ff3"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:43:08.121262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-22689645-6b66-44b1-b7bd-13c9f7b584e9 req-9f10e52b-30ac-4f92-abd9-5c6a1a484b84 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:08.121727 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-22689645-6b66-44b1-b7bd-13c9f7b584e9 req-9f10e52b-30ac-4f92-abd9-5c6a1a484b84 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:08.133633 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-22689645-6b66-44b1-b7bd-13c9f7b584e9 req-9f10e52b-30ac-4f92-abd9-5c6a1a484b84 service nova] Creating event network-changed:044d2673-4780-4c56-a1dd-2017aeb96ff3 for instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 on hv-cinder-83979 May 31 18:43:08.138868 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-22689645-6b66-44b1-b7bd-13c9f7b584e9 req-9f10e52b-30ac-4f92-abd9-5c6a1a484b84 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039636 May 31 18:43:08.139747 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 585/1159] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:43:09.006763 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:09.007366 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:09.014223 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:09.014672 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:09.015432 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:09.015863 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:09.152983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:09.160416 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-29e52bc8-7e24-4eaf-8d2b-bba2a6dc6834 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.157413 May 31 18:43:09.160988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 575/1160] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:09 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:10.177970 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:10.178690 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:10.186772 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:10.187222 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:10.187998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:10.188461 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:10.522583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:10.530715 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5fba7bda-05e1-4958-b98d-c35644d6365b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.357365 May 31 18:43:10.531583 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 586/1161] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:10 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:11.547033 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:11.547641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:11.553900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:11.554342 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:11.555091 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:11.556007 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:11.688495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:11.695721 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-77827be6-b3df-4f41-96f4-7bb686ea68d0 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.152527 May 31 18:43:11.697422 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 576/1162] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:11 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:12.713162 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:12.713854 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:12.715836 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=2 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:12.721850 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:12.722293 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:12.723053 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:12.723492 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:12.854614 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:12.861959 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-180bb062-fa7e-4621-b158-c5eafbd0bd02 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.152740 May 31 18:43:12.862515 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 587/1163] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:12 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:13.879341 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:13.879933 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:13.882176 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell0:SELECT=4 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:13.888587 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:13.889027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:13.889784 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:13.890211 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:14.017812 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:14.025814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-39b0e97b-883c-4c99-8d04-636b446efd63 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.150367 May 31 18:43:14.026371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 577/1164] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:13 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:15.043141 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:15.043785 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:15.046067 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell0:SELECT=10 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:15.051428 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:15.051880 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:15.052673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:15.053113 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:15.185625 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:15.192998 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-a121e444-b243-4301-bc70-63168606828f tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.154251 May 31 18:43:15.193544 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 588/1165] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:15 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:16.212445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:16.213218 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:16.219482 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:16.219932 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:16.220735 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:16.221174 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:16.351897 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:16.359445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-9db93931-67c0-4b1d-a928-c964bd35b1b5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.151385 May 31 18:43:16.360002 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 578/1166] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:16 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:17.376304 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:17.376931 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:17.383308 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:17.384603 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:17.385470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:17.385910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:17.520408 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:17.527843 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-623aedd5-2213-467f-a74c-565410eb2cf7 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.155479 May 31 18:43:17.528426 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 589/1167] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:17 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:18.543923 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:18.544597 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:18.551052 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:18.551504 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:18.552298 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:18.552737 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:18.688541 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:18.696113 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-b78e41bc-447b-4ec5-82a8-676bfcd46b32 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.156044 May 31 18:43:18.697186 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 579/1168] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:18 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:19.714443 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:19.715065 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:19.721552 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:19.722005 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:19.722773 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:19.723216 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:19.855506 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:19.862901 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-43f2d1e9-6817-49e3-9176-fe516a140de5 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.153112 May 31 18:43:19.863464 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 590/1169] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:19 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:20.821141 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-95420da0-4609-43b8-97c7-d138d79df29a req-e904ee39-ebb8-43bd-b1b0-741b9264dbff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17be328c-59cf-41ba-a42b-8ac4044afbe7", "name": "network-vif-plugged", "status": "completed", "tag": "044d2673-4780-4c56-a1dd-2017aeb96ff3"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:43:20.831235 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-95420da0-4609-43b8-97c7-d138d79df29a req-e904ee39-ebb8-43bd-b1b0-741b9264dbff service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:20.831679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-95420da0-4609-43b8-97c7-d138d79df29a req-e904ee39-ebb8-43bd-b1b0-741b9264dbff service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:20.842753 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-95420da0-4609-43b8-97c7-d138d79df29a req-e904ee39-ebb8-43bd-b1b0-741b9264dbff service nova] Creating event network-vif-plugged:044d2673-4780-4c56-a1dd-2017aeb96ff3 for instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 on hv-cinder-83979 May 31 18:43:20.847651 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-95420da0-4609-43b8-97c7-d138d79df29a req-e904ee39-ebb8-43bd-b1b0-741b9264dbff service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090894 May 31 18:43:20.848249 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 580/1170] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:43:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:43:20.879247 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:20.879874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:20.887648 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:20.888300 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:20.889063 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:20.889502 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:21.023075 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:21.031334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-b21412c4-e1e0-45bf-9e79-51976df076dc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.155842 May 31 18:43:21.031889 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 591/1171] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:20 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:22.049166 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:22.049859 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:22.056771 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:22.057212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:22.057972 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:22.058407 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:22.192705 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:22.200548 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4ca19007-25b2-4f5e-8e6b-ca2c2c0e6c21 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1266 microversion: 2.1 time: 0.156181 May 31 18:43:22.201117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 581/1172] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:22 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:23.216674 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:23.217287 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:23.224125 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:23.224577 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:23.225368 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:23.225799 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:23.355693 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:23.363106 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-17b34b35-d091-4a50-ba97-1630dd23d505 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1453 microversion: 2.1 time: 0.150276 May 31 18:43:23.363673 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 592/1173] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:23 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:23.384464 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:23.386045 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:23.393064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:23.393508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:23.394441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:23.394871 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:23.531355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:23.538849 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e9d6da9f-02bf-40f5-bbd5-525e454c18cb tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1453 microversion: 2.1 time: 0.162678 May 31 18:43:23.539441 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 582/1174] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:23 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1453 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:24.471370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:43:24.472429 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:24.479010 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:24.479456 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:24.480261 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:24.480703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:24.557792 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-0b7f660f-909a-4ea4-8ee9-adfa9604ccac tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/action" status: 202 len: 0 microversion: 2.1 time: 0.089984 May 31 18:43:24.561706 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 593/1175] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:43:24 2022] POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:43:24.570712 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:24.572807 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:24.583830 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:24.584958 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:24.586043 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:24.586521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:24.816237 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:24.826122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-cb53ca49-979e-4fdb-ad22-620c6618926f tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1749 microversion: 2.1 time: 0.262416 May 31 18:43:24.826754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 583/1176] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:24 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1749 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:25.379241 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [req-5f136611-c678-498a-9272-5f2c12f8d71a req-cc99251e-944c-4bad-b96a-3ca179301368 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17be328c-59cf-41ba-a42b-8ac4044afbe7", "tag": "044d2673-4780-4c56-a1dd-2017aeb96ff3"}]} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:43:25.389511 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-5f136611-c678-498a-9272-5f2c12f8d71a req-cc99251e-944c-4bad-b96a-3ca179301368 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:25.389964 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [req-5f136611-c678-498a-9272-5f2c12f8d71a req-cc99251e-944c-4bad-b96a-3ca179301368 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:25.403449 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.compute.server_external_events [req-5f136611-c678-498a-9272-5f2c12f8d71a req-cc99251e-944c-4bad-b96a-3ca179301368 service nova] Creating event network-changed:044d2673-4780-4c56-a1dd-2017aeb96ff3 for instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 on hv-cinder-83979 May 31 18:43:25.409205 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [req-5f136611-c678-498a-9272-5f2c12f8d71a req-cc99251e-944c-4bad-b96a-3ca179301368 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123448 May 31 18:43:25.409874 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 594/1177] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:43:25.843460 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:25.844074 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:25.850457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:25.851152 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:25.852123 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:25.853246 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:26.096846 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:26.104816 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-926c090c-2993-4c2c-bf4d-5f0742a2be5a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.265155 May 31 18:43:26.105386 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 584/1178] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:25 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:27.123547 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:27.124276 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:27.130867 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:27.131305 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:27.132059 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:27.132518 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:27.277025 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:27.284871 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e7662277-26c5-4b12-bc82-722872cfdb15 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.165604 May 31 18:43:27.285428 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 595/1179] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:27 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:28.301918 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:28.302535 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:28.309216 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:28.309665 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:28.310440 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:28.310860 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:28.450488 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:28.458558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-73dad252-7842-4bc3-958f-7cec229a1ebd tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.160504 May 31 18:43:28.463967 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 585/1180] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:28 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:29.475963 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:29.476650 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:29.483752 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:29.484233 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:29.484985 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:29.485416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:29.628934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:29.637269 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-54481791-e701-4551-830f-8567a0e0297c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.165104 May 31 18:43:29.637838 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 596/1181] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:29 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:30.655305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:30.655872 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:30.661823 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:30.662269 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:30.663023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:30.663457 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:30.805754 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:30.814305 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-31d1117c-310d-46ac-9922-d58ecb381319 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.163782 May 31 18:43:30.814866 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 586/1182] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:30 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:31.831924 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:31.832536 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:31.834920 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:31.841199 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:31.841674 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:31.842438 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:31.842873 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:31.846234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:31.989580 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:31.998274 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ed214194-c903-4c90-acd3-11552312dbd2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.170123 May 31 18:43:31.998840 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 597/1183] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:31 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:33.015818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:33.016434 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:33.018817 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=37 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:33.024258 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:33.024699 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:33.025955 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:33.026412 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:33.029355 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=81 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:43:33.167561 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:33.175485 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-bc348000-fa93-4942-9526-1f6bc50fef7a tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.163502 May 31 18:43:33.176049 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 587/1184] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:33 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:43:34.193386 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:34.193991 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:34.201097 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:34.201611 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:34.202378 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:34.202809 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:34.259059 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:43:34.259641 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Tue May 31 18:43:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:43:34.347654 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:34.355712 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-703c5b0d-5f5b-4cc4-a4d1-7120a7e9fca0 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.166043 May 31 18:43:34.356311 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 598/1185] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:34 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:35.374174 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:35.374791 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:35.382228 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:35.383023 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:35.384335 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:35.384776 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:35.526270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:35.535931 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-ed1b835f-b566-4525-89c1-5d259819b1ea tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.166252 May 31 18:43:35.536520 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 588/1186] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:35 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:36.552944 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:36.553560 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:36.560135 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:36.560589 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:36.561361 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:36.561796 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:36.707497 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:36.715297 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c615e9b9-09f3-4fad-8387-fa37e7a0fe48 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1754 microversion: 2.1 time: 0.166247 May 31 18:43:36.715854 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 599/1187] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:36 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1754 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:43:37.733468 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:43:37.734083 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:43:37.740493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:37.740941 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:37.741696 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:43:37.742129 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:43:37.889398 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:43:37.897177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-576bdd8b-f1e4-46c0-9894-a328a59bed17 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1757 microversion: 2.1 time: 0.168076 May 31 18:43:37.897729 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 589/1188] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:43:37 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:44:41.379278 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=5 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:44:41.380010 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=17 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:44:41.384604 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-65708930"}} {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:44:41.385127 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:41.391899 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:41.392360 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:41.393127 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:41.393540 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:41.519817 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.network.security_group_api [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Removing security group 6301b20e-003c-4dce-af09-262b5896aedf from port b7722726-cc80-4fe2-b26f-d0e2a385fdfb May 31 18:44:41.899415 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-7de41c46-7e9e-442e-952f-163999a93f61 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/action" status: 202 len: 0 microversion: 2.1 time: 0.521773 May 31 18:44:41.900030 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 600/1189] 10.222.0.17 () {60 vars in 1277 bytes} [Tue May 31 18:44:41 2022] POST /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:44:41.911371 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=5 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:44:41.913900 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=17 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:44:41.923445 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-ffeeb765-969a-4162-a6d2-2223d144ae54 req-66b3ca80-bb97-48e3-97c4-e093a0104919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:44:41.940427 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ffeeb765-969a-4162-a6d2-2223d144ae54 req-66b3ca80-bb97-48e3-97c4-e093a0104919 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:41.940874 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ffeeb765-969a-4162-a6d2-2223d144ae54 req-66b3ca80-bb97-48e3-97c4-e093a0104919 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:41.954291 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-ffeeb765-969a-4162-a6d2-2223d144ae54 req-66b3ca80-bb97-48e3-97c4-e093a0104919 service nova] Creating event network-changed:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:44:41.962495 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-ffeeb765-969a-4162-a6d2-2223d144ae54 req-66b3ca80-bb97-48e3-97c4-e093a0104919 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053007 May 31 18:44:41.964117 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 590/1190] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:44:43.001609 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:43.002163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:43.003895 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-215ca187-3832-4940-b99d-bdac07aaf9eb req-2c973fda-6f5e-4c48-9b5f-aed03d02b4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:44:43.008334 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:43.009262 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:43.010036 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:43.010586 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:43.012710 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-215ca187-3832-4940-b99d-bdac07aaf9eb req-2c973fda-6f5e-4c48-9b5f-aed03d02b4b4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:43.013399 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-215ca187-3832-4940-b99d-bdac07aaf9eb req-2c973fda-6f5e-4c48-9b5f-aed03d02b4b4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:43.025025 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-215ca187-3832-4940-b99d-bdac07aaf9eb req-2c973fda-6f5e-4c48-9b5f-aed03d02b4b4 service nova] Creating event network-changed:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:44:43.030555 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-215ca187-3832-4940-b99d-bdac07aaf9eb req-2c973fda-6f5e-4c48-9b5f-aed03d02b4b4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030844 May 31 18:44:43.031939 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 591/1191] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:44:43.095381 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.objects.instance [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lazy-loading 'services' on Instance uuid 1a2852b7-ba02-411d-83ac-fa0278e91249 {{(pid=117589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 18:44:43.178012 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-768cd798-1fa4-4f11-b962-5c636442034b tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments/19b1e916-d5f3-486d-8f22-bd3127c53634" status: 202 len: 0 microversion: 2.1 time: 0.181238 May 31 18:44:43.178910 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 601/1192] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:44:42 2022] DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments/19b1e916-d5f3-486d-8f22-bd3127c53634 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:44:43.188604 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:43.190103 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:43.198508 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:43.199311 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:43.200768 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:43.202080 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:43.238019 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-4236bc9f-0b67-4809-9740-59ea41f81ebc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054510 May 31 18:44:43.238988 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 592/1193] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:44:43 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 18:44:44.250924 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:44.252003 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:44.258289 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:44.258993 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:44.259757 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:44.260221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:44.289563 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-e43b3c16-a95f-4363-b3a6-9f05a60cf51c tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 May 31 18:44:44.290224 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 602/1194] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:44:44 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:44:45.301760 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:45.302679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:45.309047 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:45.309493 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:45.310245 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:45.311153 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:45.339855 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a449b030-9bd2-407c-ad4f-d11d835064dc tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041569 May 31 18:44:45.340006 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 593/1195] 10.222.0.17 () {58 vars in 1301 bytes} [Tue May 31 18:44:45 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 18:44:45.349741 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:45.350234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:45.356301 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:45.356743 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:45.357495 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:45.358053 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:45.431891 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] HTTP exception thrown: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 is not attached to volume 19b1e916-d5f3-486d-8f22-bd3127c53634 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Request method failure captured: May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments/19b1e916-d5f3-486d-8f22-bd3127c53634 HTTP/1.1 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmFRCOsHYm_fJ9a0fa3hCZEGX0SmqM0IvMfxwNciYuBmy-CN_M85L7hQxHI3GEThIrSgArpXASs1RqipVynpFN7hXxgwE1PKuOhhZ-bbVDY8-8I7gVH56lNp4dcsHLsJW3es2QInj4CYZZ3S6mf5DgqUUkOk9zU0CzTW_6aRGImoxbY May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 78fa27d3fa4d47c29d8ec70e7f486638 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-TestMinimumBasicScenario-1636598837 May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:44:45.434302 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-TestMinimumBasicScenario-1636598837 May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 78fa27d3fa4d47c29d8ec70e7f486638 May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1636598837 May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-TestMinimumBasicScenario-1636598837-project May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 0b2d334ac2d14ba78886a59425e8ad1b May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-TestMinimumBasicScenario-1636598837-project May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:44:45.436851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 is not attached to volume 19b1e916-d5f3-486d-8f22-bd3127c53634 May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'server_id': '1a2852b7-ba02-411d-83ac-fa0278e91249', 'id': '19b1e916-d5f3-486d-8f22-bd3127c53634'} May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 19b1e916-d5f3-486d-8f22-bd3127c53634. May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:44:45.437921 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 is not attached to volume 19b1e916-d5f3-486d-8f22-bd3127c53634 May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 is not attached to volume 19b1e916-d5f3-486d-8f22-bd3127c53634 May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:45.439549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Returning 404 to user: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 is not attached to volume 19b1e916-d5f3-486d-8f22-bd3127c53634 {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:44:45.440862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-6f1e6730-7c06-4dc3-b4b3-a8efb1651c7e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments/19b1e916-d5f3-486d-8f22-bd3127c53634" status: 404 len: 154 microversion: 2.1 time: 0.089889 May 31 18:44:45.440862 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 603/1196] 10.222.0.17 () {58 vars in 1415 bytes} [Tue May 31 18:44:45 2022] DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249/os-volume_attachments/19b1e916-d5f3-486d-8f22-bd3127c53634 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:44:46.569985 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:46.570465 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:46.577171 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:46.578119 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:46.578877 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:46.579309 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:46.605001 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Going to try to terminate instance {{(pid=117590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:44:46.682027 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-81495ee3-7ee9-4743-b664-12e96ed8f8fe tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 204 len: 0 microversion: 2.1 time: 0.115379 May 31 18:44:46.683004 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 594/1197] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:44:46 2022] DELETE /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:44:46.692004 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:46.692703 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:46.699104 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:46.699551 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:46.700346 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:46.700780 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:46.831147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:44:46.838524 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-9c182221-98df-46b4-aa4b-34707335e8a5 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1554 microversion: 2.1 time: 0.150309 May 31 18:44:46.839074 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 604/1198] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:44:46 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1554 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:44:47.856558 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:47.857161 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:47.863814 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:47.864292 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:47.865041 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:47.865467 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:47.996332 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:44:48.004758 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e0a27bc6-ca62-447f-9788-0d82db98e2b8 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1554 microversion: 2.1 time: 0.152463 May 31 18:44:48.005325 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 595/1199] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:44:47 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 18:44:49.021584 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:49.022199 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:49.028538 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:49.028947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:49.029738 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:49.030168 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:49.231417 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b2d334ac2d14ba78886a59425e8ad1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78fa27d3fa4d47c29d8ec70e7f486638', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:44:49.239751 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-5ddbb368-fd80-45c5-b7b3-5bdffdf0211e tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 200 len: 1554 microversion: 2.1 time: 0.221962 May 31 18:44:49.240550 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 605/1200] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:44:49 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 1554 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:44:49.381585 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-9dcedde7-b6a4-405d-8d58-d1cbb1fd2e08 req-3fb0a6f1-7cf9-4c1c-9a4a-a8c9859d5a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a2852b7-ba02-411d-83ac-fa0278e91249", "name": "network-vif-deleted", "tag": "b7722726-cc80-4fe2-b26f-d0e2a385fdfb"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:44:49.391329 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9dcedde7-b6a4-405d-8d58-d1cbb1fd2e08 req-3fb0a6f1-7cf9-4c1c-9a4a-a8c9859d5a24 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:49.391770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-9dcedde7-b6a4-405d-8d58-d1cbb1fd2e08 req-3fb0a6f1-7cf9-4c1c-9a4a-a8c9859d5a24 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:49.402867 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-9dcedde7-b6a4-405d-8d58-d1cbb1fd2e08 req-3fb0a6f1-7cf9-4c1c-9a4a-a8c9859d5a24 service nova] Creating event network-vif-deleted:b7722726-cc80-4fe2-b26f-d0e2a385fdfb for instance 1a2852b7-ba02-411d-83ac-fa0278e91249 on hv-cinder-83979 May 31 18:44:49.408912 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-9dcedde7-b6a4-405d-8d58-d1cbb1fd2e08 req-3fb0a6f1-7cf9-4c1c-9a4a-a8c9859d5a24 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030958 May 31 18:44:49.409600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 596/1201] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:44:50.256640 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:50.257246 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] [instance: 1a2852b7-ba02-411d-83ac-fa0278e91249] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:44:50.264597 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:50.265248 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:50.266034 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:44:50.266470 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:44:50.279221 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] HTTP exception thrown: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 could not be found. May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Request method failure captured: May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 HTTP/1.1 May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmFRCOsHYm_fJ9a0fa3hCZEGX0SmqM0IvMfxwNciYuBmy-CN_M85L7hQxHI3GEThIrSgArpXASs1RqipVynpFN7hXxgwE1PKuOhhZ-bbVDY8-8I7gVH56lNp4dcsHLsJW3es2QInj4CYZZ3S6mf5DgqUUkOk9zU0CzTW_6aRGImoxbY May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 78fa27d3fa4d47c29d8ec70e7f486638 May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-TestMinimumBasicScenario-1636598837 May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:44:50.281130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/78fa27d3fa4d47c29d8ec70e7f486638"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-TestMinimumBasicScenario-1636598837 May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 78fa27d3fa4d47c29d8ec70e7f486638 May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1636598837 May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-TestMinimumBasicScenario-1636598837-project May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: 0b2d334ac2d14ba78886a59425e8ad1b May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-TestMinimumBasicScenario-1636598837-project May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 could not be found. May 31 18:44:50.282926 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '1a2852b7-ba02-411d-83ac-fa0278e91249'} May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 could not be found. May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:44:50.283976 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 could not be found. May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 could not be found. May 31 18:44:50.285866 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:44:50.287416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Returning 404 to user: Instance 1a2852b7-ba02-411d-83ac-fa0278e91249 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:44:50.287416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d237c6f6-3f14-45c7-951d-d2da925244f2 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249" status: 404 len: 111 microversion: 2.1 time: 0.029722 May 31 18:44:50.287416 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 606/1202] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:44:50 2022] GET /compute/v2.1/servers/1a2852b7-ba02-411d-83ac-fa0278e91249 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:44:50.291590 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-13758e69-c2b3-4dc8-8b30-39daa7fed276 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] Calling method '.version_select at 0x7ffb7414a940>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:44:50.308582 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-13758e69-c2b3-4dc8-8b30-39daa7fed276 tempest-TestMinimumBasicScenario-1636598837 tempest-TestMinimumBasicScenario-1636598837-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-741467099" status: 202 len: 0 microversion: 2.1 time: 0.021127 May 31 18:44:50.309135 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 597/1203] 10.222.0.17 () {58 vars in 1268 bytes} [Tue May 31 18:44:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-741467099 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:44:59.312901 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:44:59.313400 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:44:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:45:14.988600 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:45:14.993234 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:14.993885 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG dbcounter [-] [117590] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:45:14.999282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-02315fe1-3bc2-4b40-a21b-51043da4f0ce req-4c126b4e-3c1e-450d-806c-3db3c7c8cefa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17be328c-59cf-41ba-a42b-8ac4044afbe7", "tag": "044d2673-4780-4c56-a1dd-2017aeb96ff3"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:45:14.999610 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:15.003275 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_api:SELECT=14 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:45:15.004080 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG dbcounter [-] [117589] Writing DB stats nova_cell1:SELECT=39,nova_cell1:INSERT=1 {{(pid=117589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 18:45:15.008947 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:15.009728 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:15.010498 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:15.010940 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:15.016122 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-02315fe1-3bc2-4b40-a21b-51043da4f0ce req-4c126b4e-3c1e-450d-806c-3db3c7c8cefa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:15.016858 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-02315fe1-3bc2-4b40-a21b-51043da4f0ce req-4c126b4e-3c1e-450d-806c-3db3c7c8cefa service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:15.033283 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-02315fe1-3bc2-4b40-a21b-51043da4f0ce req-4c126b4e-3c1e-450d-806c-3db3c7c8cefa service nova] Creating event network-changed:044d2673-4780-4c56-a1dd-2017aeb96ff3 for instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 on hv-cinder-83979 May 31 18:45:15.038185 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-02315fe1-3bc2-4b40-a21b-51043da4f0ce req-4c126b4e-3c1e-450d-806c-3db3c7c8cefa service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051002 May 31 18:45:15.039134 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 598/1204] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:45:15.041154 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:45:15.130549 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1141dc69-1088-4f59-9fdd-06bd81615d25 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 204 len: 0 microversion: 2.1 time: 0.144830 May 31 18:45:15.131610 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 607/1205] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:45:14 2022] DELETE /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:45:15.141813 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:15.142512 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:15.151204 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:15.151654 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:15.152455 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:15.152880 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:15.320985 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:45:15.329282 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e59beb16-4272-45e7-8b34-60991290c202 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1578 microversion: 2.1 time: 0.192604 May 31 18:45:15.330051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 599/1206] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:15 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1578 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:45:16.347310 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:16.348014 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:16.355078 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:16.355571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:16.356392 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:16.357335 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:16.547462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:45:16.554895 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-c853183a-1b17-47c5-8571-8edc112fc434 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1578 microversion: 2.1 time: 0.211776 May 31 18:45:16.555450 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 608/1207] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:16 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1578 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:45:17.327952 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-fd0e2655-75d5-4ffa-a3e0-c336311c48cd req-4e07433b-a801-40de-8081-4484dc2ac47c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17be328c-59cf-41ba-a42b-8ac4044afbe7", "name": "network-vif-deleted", "tag": "044d2673-4780-4c56-a1dd-2017aeb96ff3"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:45:17.336983 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fd0e2655-75d5-4ffa-a3e0-c336311c48cd req-4e07433b-a801-40de-8081-4484dc2ac47c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:17.337425 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fd0e2655-75d5-4ffa-a3e0-c336311c48cd req-4e07433b-a801-40de-8081-4484dc2ac47c service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:17.349697 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-fd0e2655-75d5-4ffa-a3e0-c336311c48cd req-4e07433b-a801-40de-8081-4484dc2ac47c service nova] Creating event network-vif-deleted:044d2673-4780-4c56-a1dd-2017aeb96ff3 for instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 on hv-cinder-83979 May 31 18:45:17.354475 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-fd0e2655-75d5-4ffa-a3e0-c336311c48cd req-4e07433b-a801-40de-8081-4484dc2ac47c service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031114 May 31 18:45:17.355030 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 600/1208] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:45:17.572235 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:17.572821 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:17.580069 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:17.580551 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:17.581321 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:17.581763 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:17.652457 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:45:17.661331 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-1eadec14-c780-44f9-a05f-e052b0ac78a9 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 200 len: 1225 microversion: 2.1 time: 0.092880 May 31 18:45:17.662370 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 609/1209] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:17 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:45:18.683274 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:18.683891 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 17be328c-59cf-41ba-a42b-8ac4044afbe7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:18.691058 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:18.691479 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:18.692270 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:18.692702 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:18.705843 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] HTTP exception thrown: Instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 could not be found. May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Request method failure captured: May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 HTTP/1.1 May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABilmBjgpvSmtG6hjqIY4alzZ20W4F-r15rqmbIsTvEW6mLIeCvAbTGv5wHW8QQ7v4CUjMvFujAqwf6_dQn9tIVTF1UJU1QaxfEYcmCn6kVSn98eORiQB7NFAQAKtGboncPIwqhniGPHB-pLWAqcU2jj4hyQWSpc_ghTjIWsASJhIwJTpM May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:45:18.707421 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-TestVolumeBootPattern-619990332 May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: ebcdfe9038fe4e0580a4fe79ae13e520 May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 could not be found. May 31 18:45:18.709167 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '17be328c-59cf-41ba-a42b-8ac4044afbe7'} May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 could not be found. May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:45:18.710177 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 could not be found. May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 could not be found. May 31 18:45:18.711755 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:18.713212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Returning 404 to user: Instance 17be328c-59cf-41ba-a42b-8ac4044afbe7 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:45:18.713212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-a1e9192f-7464-4783-adb2-f827d004442b tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7" status: 404 len: 111 microversion: 2.1 time: 0.030406 May 31 18:45:18.713212 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 601/1210] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:18 2022] GET /compute/v2.1/servers/17be328c-59cf-41ba-a42b-8ac4044afbe7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:45:21.761284 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:21.761823 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:21.765070 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-fab24d1e-a093-48e7-b1c2-2512583108e9 req-b6cbe05e-5411-43f3-9198-e832556ec0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3993a76-46e5-432c-8d8e-8e6b8225c0e7", "tag": "79376145-16eb-461c-8516-feb786a6f974"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:45:21.768163 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:21.768967 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:21.769740 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:21.770428 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:21.773539 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fab24d1e-a093-48e7-b1c2-2512583108e9 req-b6cbe05e-5411-43f3-9198-e832556ec0e4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:21.773978 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-fab24d1e-a093-48e7-b1c2-2512583108e9 req-b6cbe05e-5411-43f3-9198-e832556ec0e4 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:21.785668 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-fab24d1e-a093-48e7-b1c2-2512583108e9 req-b6cbe05e-5411-43f3-9198-e832556ec0e4 service nova] Creating event network-changed:79376145-16eb-461c-8516-feb786a6f974 for instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 on hv-cinder-83979 May 31 18:45:21.791556 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-fab24d1e-a093-48e7-b1c2-2512583108e9 req-b6cbe05e-5411-43f3-9198-e832556ec0e4 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029586 May 31 18:45:21.792506 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 602/1211] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:45:21.799995 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Going to try to terminate instance {{(pid=117589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 18:45:21.880698 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-afb838fc-2c34-4b89-88a1-18bd5ae7cccc tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 204 len: 0 microversion: 2.1 time: 0.123019 May 31 18:45:21.881153 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 610/1212] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:45:21 2022] DELETE /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 18:45:21.890949 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:21.899498 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:21.911490 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:21.912168 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:21.913028 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:21.913540 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:22.056966 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.policy [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:45:22.064658 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-e7366a26-9c8d-4cc2-9269-f16cce319e1c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1578 microversion: 2.1 time: 0.178329 May 31 18:45:22.065439 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 603/1213] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:21 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:45:23.082869 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:23.083573 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:23.090021 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:23.090473 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:23.092073 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:23.092820 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:23.224857 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:45:23.232472 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-fdf8bdd9-8b40-43f4-95cc-38d8923cd082 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1578 microversion: 2.1 time: 0.153763 May 31 18:45:23.233028 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 611/1214] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:23 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:45:24.148064 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [req-ae77b6d5-db51-4579-9cbf-20453f458ee0 req-d6c7845c-d714-4bb5-b8ef-015a02f7b2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3993a76-46e5-432c-8d8e-8e6b8225c0e7", "name": "network-vif-deleted", "tag": "79376145-16eb-461c-8516-feb786a6f974"}]} {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 18:45:24.157077 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ae77b6d5-db51-4579-9cbf-20453f458ee0 req-d6c7845c-d714-4bb5-b8ef-015a02f7b2f9 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:24.157521 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [req-ae77b6d5-db51-4579-9cbf-20453f458ee0 req-d6c7845c-d714-4bb5-b8ef-015a02f7b2f9 service nova] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:24.169036 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.compute.server_external_events [req-ae77b6d5-db51-4579-9cbf-20453f458ee0 req-d6c7845c-d714-4bb5-b8ef-015a02f7b2f9 service nova] Creating event network-vif-deleted:79376145-16eb-461c-8516-feb786a6f974 for instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 on hv-cinder-83979 May 31 18:45:24.175336 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [req-ae77b6d5-db51-4579-9cbf-20453f458ee0 req-d6c7845c-d714-4bb5-b8ef-015a02f7b2f9 service nova] 10.222.0.17 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030586 May 31 18:45:24.175928 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 604/1215] 10.222.0.17 () {64 vars in 1317 bytes} [Tue May 31 18:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 18:45:24.249953 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:24.250571 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:24.257085 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:24.257537 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:24.258307 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:24.258997 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:24.325130 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.policy [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebcdfe9038fe4e0580a4fe79ae13e520', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6710d1fa5fbb49c28aa55ae4cd810dc7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 18:45:24.333368 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-d4d44858-284b-45a8-84e0-6406a901a58c tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 200 len: 1226 microversion: 2.1 time: 0.087850 May 31 18:45:24.333934 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 612/1216] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:24 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 1226 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 18:45:25.350679 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:25.351378 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: b3993a76-46e5-432c-8d8e-8e6b8225c0e7] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:25.358183 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:25.358629 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:25.359385 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:25.359818 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:25.374567 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] HTTP exception thrown: Instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 could not be found. May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Request method failure captured: May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 HTTP/1.1 May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABilmBjgpvSmtG6hjqIY4alzZ20W4F-r15rqmbIsTvEW6mLIeCvAbTGv5wHW8QQ7v4CUjMvFujAqwf6_dQn9tIVTF1UJU1QaxfEYcmCn6kVSn98eORiQB7NFAQAKtGboncPIwqhniGPHB-pLWAqcU2jj4hyQWSpc_ghTjIWsASJhIwJTpM May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:45:25.376192 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: ebcdfe9038fe4e0580a4fe79ae13e520 May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 could not be found. May 31 18:45:25.378054 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': 'b3993a76-46e5-432c-8d8e-8e6b8225c0e7'} May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 could not be found. May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:45:25.379071 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 could not be found. May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 could not be found. May 31 18:45:25.380770 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.382293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Returning 404 to user: Instance b3993a76-46e5-432c-8d8e-8e6b8225c0e7 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:45:25.382293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-83fa2b60-7040-4794-8377-beace5401671 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7" status: 404 len: 111 microversion: 2.1 time: 0.031156 May 31 18:45:25.382293 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 605/1217] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:25 2022] GET /compute/v2.1/servers/b3993a76-46e5-432c-8d8e-8e6b8225c0e7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:45:25.819421 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:25.819937 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.compute.api [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:25.827560 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:25.828123 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:25.828903 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:25.829344 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG oslo_concurrency.lockutils [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:25.842458 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.wsgi [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] HTTP exception thrown: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Request method failure captured: May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: request: DELETE /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 HTTP/1.1 May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept: application/json May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Accept-Encoding: identity May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Connection: close May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Length: 0 May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Content-Type: application/json May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Host: 10.222.0.17 May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Openstack-System-Scope: None May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: User-Agent: python-urllib3/1.26.9 May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Auth-Token: gAAAAABilmBjgpvSmtG6hjqIY4alzZ20W4F-r15rqmbIsTvEW6mLIeCvAbTGv5wHW8QQ7v4CUjMvFujAqwf6_dQn9tIVTF1UJU1QaxfEYcmCn6kVSn98eORiQB7NFAQAKtGboncPIwqhniGPHB-pLWAqcU2jj4hyQWSpc_ghTjIWsASJhIwJTpM May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Id: None May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Domain-Name: None May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Identity-Status: Confirmed May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Is-Admin-Project: True May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Id: default May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Domain-Name: Default May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Project-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Role: reader,member May 31 18:45:25.844147 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Roles: reader,member May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-Tenant-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Id: default May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Domain-Name: Default May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Id: ebcdfe9038fe4e0580a4fe79ae13e520 May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: X-User-Name: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: method: > May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: exception: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.845851 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: action_args: {'id': '6528eeaf-9d4b-4360-8a1a-1f2b78983f95'} May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:45:25.846825 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.848462 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: ERROR nova.api.openstack.wsgi May 31 18:45:25.850167 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Returning 404 to user: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. {{(pid=117589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:45:25.850167 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-ada00fe7-e9b5-4f54-84a3-eb40a3663132 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "DELETE /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 404 len: 111 microversion: 2.1 time: 0.029929 May 31 18:45:25.850167 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 613/1218] 10.222.0.17 () {58 vars in 1238 bytes} [Tue May 31 18:45:25 2022] DELETE /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 18:45:25.854316 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '>' {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:25.854931 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.compute.api [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] [instance: 6528eeaf-9d4b-4360-8a1a-1f2b78983f95] Fetching instance by UUID {{(pid=117590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 18:45:25.861021 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:25.861478 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:25.862239 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 18:45:25.862675 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG oslo_concurrency.lockutils [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Lock "e77dd333-c7fe-440b-84b1-5d076cdc10bf" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 18:45:25.876655 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.wsgi [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] HTTP exception thrown: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Request method failure captured: May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: request: GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 HTTP/1.1 May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept: application/json May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Accept-Encoding: identity May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Connection: close May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Length: 0 May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Content-Type: application/json May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Host: 10.222.0.17 May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Openstack-System-Scope: None May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: User-Agent: python-urllib3/1.26.9 May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Auth-Token: gAAAAABilmBjgpvSmtG6hjqIY4alzZ20W4F-r15rqmbIsTvEW6mLIeCvAbTGv5wHW8QQ7v4CUjMvFujAqwf6_dQn9tIVTF1UJU1QaxfEYcmCn6kVSn98eORiQB7NFAQAKtGboncPIwqhniGPHB-pLWAqcU2jj4hyQWSpc_ghTjIWsASJhIwJTpM May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Id: None May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Domain-Name: None May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Identity-Status: Confirmed May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Is-Admin-Project: True May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Id: default May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Domain-Name: Default May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Project-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Role: reader,member May 31 18:45:25.878163 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Roles: reader,member May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.17:8080", "publicURL": "http://10.222.0.17:8080/v1/AUTH_6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/volume/v3/6710d1fa5fbb49c28aa55ae4cd810dc7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.17/compute/v2.1"}]}] May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Id: 6710d1fa5fbb49c28aa55ae4cd810dc7 May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-Tenant-Name: tempest-TestVolumeBootPattern-619990332 May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Id: default May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Domain-Name: Default May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Id: ebcdfe9038fe4e0580a4fe79ae13e520 May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: X-User-Name: tempest-TestVolumeBootPattern-619990332-project May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: method: > May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: exception: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.879847 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: action_args: {'id': '6528eeaf-9d4b-4360-8a1a-1f2b78983f95'} May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: {{(pid=117590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 18:45:25.881051 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. May 31 18:45:25.882681 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: ERROR nova.api.openstack.wsgi May 31 18:45:25.885079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: DEBUG nova.api.openstack.wsgi [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Returning 404 to user: Instance 6528eeaf-9d4b-4360-8a1a-1f2b78983f95 could not be found. {{(pid=117590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 18:45:25.885079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO nova.api.openstack.requestlog [None req-7eaf87f7-e6c8-45a9-8b6a-0c578dcc0613 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95" status: 404 len: 111 microversion: 2.1 time: 0.029140 May 31 18:45:25.885079 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: [pid: 117590|app: 0|req: 606/1219] 10.222.0.17 () {58 vars in 1235 bytes} [Tue May 31 18:45:25 2022] GET /compute/v2.1/servers/6528eeaf-9d4b-4360-8a1a-1f2b78983f95 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 18:45:27.181211 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: DEBUG nova.api.openstack.wsgi [None req-2093bb6e-5c5e-4e6b-93a1-b52f5520da57 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] Calling method '.version_select at 0x7ffb7416e160>' {{(pid=117589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 18:45:27.206454 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO nova.api.openstack.requestlog [None req-2093bb6e-5c5e-4e6b-93a1-b52f5520da57 tempest-TestVolumeBootPattern-619990332 tempest-TestVolumeBootPattern-619990332-project] 10.222.0.17 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1714846868" status: 202 len: 0 microversion: 2.1 time: 0.028862 May 31 18:45:27.206902 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: [pid: 117589|app: 0|req: 614/1220] 10.222.0.17 () {58 vars in 1262 bytes} [Tue May 31 18:45:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1714846868 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 18:46:54.268938 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:46:54.269564 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Tue May 31 18:46:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:48:14.155756 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:48:14.156441 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:48:19.321173 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:48:19.321810 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:48:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:48:35.409884 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:48:35.410469 dv-cinder-839793-15-iscsi devstack@n-api.service[117589]: Tue May 31 18:48:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:48:43.085924 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:48:43.086509 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Tue May 31 18:48:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:49:59.534878 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:49:59.535633 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Tue May 31 18:49:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 18:50:14.277418 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 18:50:14.278357 dv-cinder-839793-15-iscsi devstack@n-api.service[117590]: Tue May 31 18:50:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!